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available) 

W.  DATA  COLLECTION  SUMMARY 

(which  shows  the  lack  of  data  for  all  the  3 1  initiatives) 


EXECUTIVE  SUMMARY 


In  December  1992,  Lieutenant  General  Alcide  LaNoue,  U.S.  Army  Surgeon  General, 
established  the  Advanced  Medical  Technology  and  Telemedicine  Initiatives,  as  "  ...a  method  of 
projecting  the  consultative  skills  of  a  medical  center  to  field  hospitals",  with  the  US  Army 
Medical  Department  dedicated  to  becoming  the  world-wide  leader  and  proponent  for  advanced, 
high-technology  health  care  delivery  systems  to  minimize  combat  casualties  on  the  battlefield1  or 
wherever  deployed.  This  vision  initiated  a  flurry  of  programs  of  technology  imiovation  under 
the  rubric  of  "telemedicine”. 

After  several  years,  DOD  telemedicine  programs  overall  were  examined  by  the  GAO, 
which  published  results  in  Telemedicine:  Federal  Strategy  is  Needed  to  Guide  Investments 
released  in  February  19972.  This  report  criticized  the  host  of  federal  initiatives  in  telemedicine 
for  not  articulating  a  coherent  strategy  for  their  investments.  The  DOD  received  a  predominance 
of  attention  in  the  GAO  report  since  it  "is  the  largest  federal  investor  with  $262  million  and 
considered  a  leader  in  developing  this  technology."3 

The  ultimate  findings  of  the  report,  especially  concerning  the  performance  of  the  DOD, 
strongly  conclude  that  the  lack  of  an  overall  "department- wide  strategy"  has  hindered  a  wise 
stewardship  of  the  financial  investment4.  The  report  also  concludes  that  due  to  a  lack  of  clear 
data  it  is  still  hard  at  this  point  to  confidently  state  whether  telemedicine  can  demonstrate  any 
clear  benefits,  either  by  lowering  the  cost  of  delivery  or  by  enhancing  clinical  effectiveness5. 

In  order  to  help  address  GAO  concerns,  under  the  guidance  LTG  Ronald  R.  Blanck,  TSG 
and  MG  James  B.  Peake,  CG,  AMEDD  Center  and  School,  the  Re-Engineering  Laboratory 
(REL)  was  contracted  to  develop  an  assessment  tool  and  employ  it  to  analyze  current  Army 
Medical  Department  (AMEDD)  or  AMEDD-led  telemedicine  initiatives  in  TRICARE  Region  6. 

The  focus  of  the  study  was  to  examine  what  was  the  factual  landscape  regarding 
telemedicine  across  the  entire  region  with  a  special  emphasis  on  the  user  community.  Visits 
were  scheduled  with  both  clinical  and  technical  staff  to  see  how  they  were  applying  the  tools  of 
telemedicine  technologies,  e.g.  telecommunications,  computers,  etc.  for  the  diagnosing  and 
treating  of  patients.  Issues,  such  as  clinical  enhancements  and  costs  effectiveness  were  to  be 
highlighted  and  catalogued,  if  possible,  later  analyzed  and  applied  to  strategic  planning 
processes. 


1  Telemedicine  Research  Laboratory,  “Army  Applied  Medical  Technology  Overview”,  TRL:  Cutting  Edge  Medical 
Technology. 

2  GAO,  Telemedicine:  Federal  Strategy  is  Needed  to  Guide  Investments,  (Washington  D.C.:  GAO,  1997) 

3  GAO,  pp.  3 


5 


;  GAO,  pp.  34 

CAO,  pp.  75 
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The  REL  tasks  include: 


•  Develop  a  health  technology  assessment  tool  to  evaluate  the  effectiveness  of 
current  AMEDD  and  AMEDD-led  telemedicine  initiatives.  Success  criteria 
include,  but  are  not  limited  to: 

•  Achieving  specific  telemedicine  initiative  project  objectives 

•  Keeping  active  duty  forces  on  the  job  and  taking  healthcare  to  the  field 

•  Enhancing  and  measuring  the  health  and  fitness  of  the  force 

•  Modifying  the  total  Military  Health  Services  System  (MHSS)  staffing 
model  to  reduce  the  size  and  skill  mix  requirement  for  support  of 
military  operations 

•  Increasing  the  efficiency  of  the  MHSS  staff  in  peacetime,  maintaining 
military  readiness  skills  of  the  MHSS  active  duty  staff,  and  reducing 
the  health  service  requirements  of  TRICARE  contractors 

In  addition, 

•  Analyze  current  AMEDD  and  AMEDD-led  telemedicine  initiatives  within  the 
DOD  Telemedicine  Testbed  Database  using  the  telemedicine  health  technology 
assessment  tool.  The  assessment  tool  will  incorporate  the  following  criteria  into 
the  development  methodology: 

•  Group  similar  AMEDD  and  AMEDD-led  telemedicine  initiatives 
based  on  obvious  relationships 

•  Sequence  AMEDD  and  AMEDD-led  telemedicine  initiatives  by  rank 
order  based  on  value  derived  by  applying  the  criteria  described  above 

•  Analyze  initiatives  for  redundancy  and  identify  superior  AMEDD  and 
AMEDD-led  telemedicine  initiatives  based  on  criteria  described  above 

•  Identify  existing  gaps  between  current  AMEDD  and  AMEDD-led 
telemedicine  initiatives  and  recommend  new  initiatives  to  accomplish 
the  criteria  described  above 

•  Analyze  the  merit  of  each  AMEDD  and  AMEDD-led  telemedicine 
initiatives  against  the  criteria  described  above 
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In  order  to  develop  the  health  technology  assessment  tool  for  telemedicine,  an 
examination  was  undertaken  of  critical  factors  or  inhibitors  that  would  stand  in  the  way  of 
successful  telemedicine  implementation  in  the  AMEDD.  This  process  was  extended  to  the 
identification  of  technology,  business,  and  delivery  of  care  factors,  which  could  be  changed  to 
reduce  the  impact  of  the  inhibitors.  These  preliminary  factors  and  their  relative  importance  were 
determined  by  the  use  of  the  Analytic  Hierarchy  Process  (AHP)  and  were  subject  to  verification 
by  the  data  collection  results.  The  health  technology  assessment  tool  included  several  models 
based  on  the  analytic  hierarchy  process  and  utilized  the  decision  support  software  called  Expert 
Choice™.  These  preliminary  models  included  both  types  of  models:  evaluation  and  choice,  and 
ratings. 


Three  sites,  Brooke  Army  Medical  Center  (BAMC)  at  Fort  Sam  Houston,  Darnell  Army 
Community  Hospital  (DACH)  at  Ft.  Hood,  and  Baynes-Jones  Army  Hospital  (BJACH)  at  Ft. 
Polk,  were  selected  by  the  Great  Plains  Regional  Medical  Command  (GPRMC)  and  their 
telemedicine  projects  (initiatives)  were  identified  for  analysis.  The  technology  profile  served  as 
a  starting  point  for  data  collection  of  qualitative  and  quantitative  data. 

REL  was  courteously  received  throughout  the  AMEDD  where  respondents  took  valuable 
time  to  complete  the  survey  as  well  as  sharing  their  views.  Among  the  participants,  regardless  of 
rank  or  specialization  was  a  collective  commitment  and  passion  to  reap  the  best  from  technology 
to  better  fulfill  the  mission  goals  of  the  AMEDD.  Special  appreciation  is  due  to  COL  Stuart 
Baker  and  COL  Harrison  Hassell,  M.D.  for  their  thoughtful  guidance,  support  and  coordination. 

1.  FINDINGS 

1 . 1  Virtually  no  telemedicine  systems  were  operational  at  the  time  of  REL  data 
collection. 

1 .2  There  was  not  much  data  available  and  what  was  available  was  not  what  was 
needed. 

1.3  It  was  difficult  to  determine  relative  importance  and  weighting  factors  needed  to 
evaluate  the  AMEDD  initiatives  in  Region  6. 

1 .4  There  is  no  up-to-date,  comprehensive  and  documented  business  plan  for  Region 

6. 

1 .5  The  initiatives  within  Region  6  are  unfocused  and  did  not  have  individual  project 
management  plans. 

1 .6  Telemedicine  information  is  being  shared  within  Region  6. 

1 .7  There  is  clinician  interest  in  leveraging  telemedicine  and  information  technology 
to  enhance  quality  and  efficiency  of  care  with  users  looking  forward  to  a 
meaningful  role  in  the  decision  process  for  the  adoption  of  future  technology 
applications. 
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2.0  RECOMMENDATIONS 


2.1  Conduct  specific  decision-making  sessions  supported  by  an  AHP  tool  to  verify 
the  preliminary  telemedicine  objectives  with  the  purpose  of  synthesizing  relative 
priority  and  weights. 

2.2  Initiate  data  collection  within  Region  6  to  support  the  AHP  model  data  input. 

2.3  Re-evaluate  existing  telemedicine  equipment  within  the  region  to  assess 
effectiveness  for  current  and  future  needs  and  with  clinician  participating  fully  in 
the  evaluation  process. 

2.4  Adopt  a  project  management  focus  at  the  initiative  level. 

2.5  Conduct  periodic  project  audits  to  assess  the  return-on-investment  and  capture 
lessons  learned  for  long-term  improvement  within  the  region. 

2.6  Develop  an  overarching  AMEDD  telemedicine  business  plan  for  Region  6  based 
on  application  of  the  AHP  Model. 
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1. 


ABSTRACT 


This  report  describes  the  development  of  a  telemedicine  health  technology  assessment 
tool  using  the  Analytic  Hierarchy  Process  and  its  application  in  the  analysis  of  current  Army 
Medical  Department  (AMEDD)  or  AMEDD-led  telemedicine  initiatives  in  TRICARE  Region  6. 
As  published  in  the  GAO  report,  Telemedicine:  Federal  Strategy  is  Needed  to  Guide 
Investments,  02/14/97,  GAO/NSIAD/HEHS-97-67  the  GAO  recommends  that  the  Secretary  of 
Defense  develop  and  submit  to  Congress  an  overarching  telemedicine  research  and  development 
and  operational  strategy.  To  provide  AMEDD  input  to  DOD  policymakers,  a  health  technology 
assessment  of  current  AMEDD  and  AMEDD-led  telemedicine  initiatives  is  needed  to  identify 
the  scope  of  current  programs  and  the  relative  benefit  added  by  each  program  to  the  healthcare 
delivery  mission  of  the  AMEDD 

In  order  to  develop  the  health  technology  assessment  tool  for  telemedicine,  an 
examination  was  undertaken  of  critical  factors  or  inhibitors  that  would  stand  in  the  way  of 
successful  telemedicine  implementation  in  the  AMEDD.  This  process  was  extended  to  the 
identification  of  technology,  business,  and  delivery  of  care  factors,  which  could  be  changed  to 
reduce  the  impact  of  the  inhibitors.  These  preliminary  factors  and  their  relative  importance  were 
determined  by  the  use  of  the  Analytic  Hierarchy  Process  (AHP)  and  were  subject  to  verification 
by  the  data  collection  results. 

The  health  technology  assessment  tool  included  several  models  based  on  the  Analytic 
Hierarchy  Process  and  utilized  the  decision  support  software  Expert  Choice™.  These 
preliminary  models  included  two  types  of  models:  evaluation  and  choice,  and  ratings.  The  REL 
team  constructed  the  models  with  the  assistance  and  guidance  of  experienced  practitioners  of 
AHP/Expert  Choice  to  include  Dr.  Ernest  Forman  (patent  holder  of  AHP/Expert  Choice)  and  Ms. 
Cynthia  Knott,  a  Ph.D.  candidate  under  advisement  of  Dr.  Ernest  H.  Forman). 

Three  sites  selected  for  analysis  within  the  Great  Plains  Regional  Medical  Command 
(GPRMC)  were  Brooke  Army  Medical  Center  (BAMC)  at  Fort  Sam  Houston,  Texas;  Darnall 
Army  Community  Hospital  (DACH)  at  Fort  Hood,  Texas;  and  Bayne-Jones  Army  Community 
Hospital  (BJACH)  at  Fort  Polk,  Louisiana.  The  Technology  Profile  served  as  a  starting  point  for 
data  collection  of  qualitative  and  quantitative  data.  Unfortunately,  there  was  insufficient  data  for 
any  type  of  conclusive  analysis.  Therefore,  simulated  data  provided  insight  into  the  capabilities 
of  the  health  technology  assessment  tool  using  the  Analytic  Hierarchy  Process  in  the  areas  of 
resource  allocation,  cost-benefit  analysis,  cost-benefit-risk  analysis,  and  optimization  of  benefits. 
The  assessment  tool  provides  the  basis  for  recommendations  for  project  prioritization  and  a 
starting  point  for  additional  analysis  in  developing  an  overarching  AMEDD  telemedicine 
strategy. 
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2. 


BACKGROUND 


HISTORY  AND  CONTEXT 


In  December  1992,  Lieutenant  General  Alcide  LaNoue,  United  States  (U.S.) 

Army  Surgeon  General,  established  the  Advanced  Medical  Technology  and  Telemedicine 
Initiatives,  as  "  ...a  method  of  projecting  the  consultative  skills  of  a  medical  center  to  field 
hospitals",  with  the  U.  S.  Army  Medical  Department  dedicated  to  becoming  the  world¬ 
wide  leader  and  proponent  for  advanced,  high-technology  health  care  delivery  systems  to 
minimize  combat  casualties  on  the  battlefield1  or  wherever  deployed.  The  "high- 
technology"  component  of  these  activities  rests  on  the  current  proliferation  in  biosensors, 
computer  and  telecommunication  systems  promulgated  by  a  number  of  key  Department 
of  Defense  (DOD)  organizations,  including  the  U.S.  Army  Medical  Research  and 
Materiel  Command  (USAMRMC)  and  Defense  Advanced  Research  Projects  Agency 
(DARPA). 

These  organizations  have  been  the  central  springboard  for  the  emergence  of  a 
national  and  international  debate  on  the  potential  of  digital  medicine  or,  as  is  now 
generically  called,  "telemedicine"  to  reengineer  the  way  that  the  health  care  industry  is 
supported.  Extensive  press  coverage,  conferences,  and  publications  have  generated 
widespread  excitement  and  expectations. 

The  United  States  Congress  is  intensively  interested  in  the  applications  and 
implications  of  telemedicine  on  national  health  policy.  It  has  held  a  number  of  hearings 
and  actual  "on-site"  demonstrations  in  the  Capitol  building2.  As  a  consequence,  both 
Congress  and  the  White  House  are  focused  on  how  "telemedicine"  could  help  resolve 
some  of  the  complex  issues  that  surround  the  health  care  policy  debates  over  the  last  few 
years3.  Telemedicine  seems  to  offer  a  method  which  can  help  to  address  issues  such  as 
access  and  lower  costs.  Internal  and  external  DOD  publications  and  presentations  have 
had  an  important  effect  in  introducing  telemedicine’s  potential.  As  a  result,  the  DOD  has 
found  itself,  at  times,  willingly  or  not,  the  source  of  verification  and  wisdom  on  the  state 
of  the  progress  of  "telemedicine". 

Like  the  DOD,  many  other  Federal  agencies  have  made  investments  in 
telemedicine,  but  nowhere  are  their  efforts  at  the  level,  commitment,  and  intensity  of  the 
DOD.  As  with  any  high-visibility  and  high-risk  technology  venture,  public  review  is 
understandable.  Review  and  scrutiny,  official  and  unofficial,  is  helpful  because  of  the 
logical  implications  for  not  only  military  health  care  delivery  but  also  for  civilian 
healthcare. 


1  Telemedicine  Research  Laboratory,  “Army  Applied  Medical  Technology  Overview”,  Telemedicine  Research 
Laboratory  (TRL):  Cutting  Edge  Medical  Technology. 

2  House  of  Representative,  Subcommittee  on  Technology,  Committee  on  Science,  Medical  Technology 
Development  and  Commercialization,  (Washington  D.C.:  Committee  Hearings  of  U.S.  House  of  Representatives, 
1995) 

3  U.S.  Department  of  Commerce,  NTIA,  Telemedicine  Report  to  Congress,  (Washington  D.C.:  U.S.  Department  of 
Commerce,  1997) 
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The  Government  Accounting  Office  (GAO)  conducted  an  extensive  and 
organized  review  of  recent  government  assessments  entitled  Telemedicine:  Federal 
Strategy  is  Needed  to  Guide  Investments,  released  in  February  19974.  The  overall 
assessment  and  conclusions  of  this  report  reflect  Federal  and  State  activities.  The  reason 
for  focus  on  the  DOD  in  the  GAO  report  is  the  fact  that  it " . .  .is  the  largest  federal 
investor  with  $262  million  and  considered  a  leader  in  developing  this  technology."5 

The  ultimate  findings  of  the  report,  especially  on  the  performance  of  the  DOD, 
conclude  that  the  lack  of  an  overall  "department- wide  strategy"  has  hindered  a  wise 
stewardship  of  the  financial  investment6 7.  The  report  also  concludes  that  due  to  a  lack  of 
clear  data  it  is  still  hard  at  this  point  to  confidently  state  whether  telemedicine  can 
demonstrate  any  benefits,  either  by  lowering  the  cost  of  delivery  or  by  enhancing  clinical 
effectiveness  . 


THE  REL  PROJECT 


In  order  to  help  address  GAO  concerns,  under  the  guidance  LTG  Ronald  R. 
Blanck,  TSG  and  MG  James  B.  Peake,  CG,  AMEDD  Center  and  School,  the  Re- 
Engineering  Laboratory  (REL)  was  contracted  to  develop  an  assessment  tool  and  employ 
it  to  analyze  current  Army  Medical  Department  (AMEDD)  or  AMEDD-led  telemedicine 
initiatives  in  TRICARE  Region  6. 


4  4  GAO,  Telemedicine:  Federal  Strategy  is  Needed  to  Guide  Investments,  (Washington  D.C.:  GAO,  1997) 

5  GAO  Report,  pp.  3 

6  GAO  Report,  pp.  34 

7  GAO  Report,  pp.  75 
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3. 


STATEMENT  OF  WORK 


In  order  to  help  address  GAO  concerns,  under  the  guidance  LTG  Ronald  R.  Blanck,  TSG 
and  MG  James  B.  Peake,  CG,  AMEDD  Center  and  School,  the  Re-Engineering  Laboratory 
(REL)  was  contracted  to  develop  an  assessment  tool  and  employ  it  to  analyze  current  Army 
Medical  Department  (AMEDD)  or  AMEDD-led  telemedicine  initiatives  in  TRICARE  Region  6. 

The  focus  of  the  study  was  to  examine  what  was  the  factual  landscape  regarding 
telemedicine  across  the  entire  region  with  a  special  emphasis  on  the  user  community.  Visits 
were  scheduled  with  both  clinical  and  technical  staff  to  see  how  they  were  applying  the  tools  of 
telemedicine  technologies,  e.g.  telecommunications,  computers,  etc.  for  the  diagnosing  and 
treating  of  patients.  Issues,  such  as  clinical  enhancements  and  costs  effectiveness  were  to  be 
highlighted  and  catalogued,  and  if  possible,  later  analyzed  and  applied  to  strategic  planning 
processes. 

The  REL  tasks  include: 

THE  TOOL 

•  Develop  a  health  technology  assessment  tool  to  evaluate  the  effectiveness  of  current 
AMEDD  and  AMEDD-led  telemedicine  initiatives.  Success  criteria  include,  but  are 
not  limited  to: 

•  Achieving  specific  telemedicine  initiative  project  objectives 

•  Keeping  active  duty  forces  on  the  job  and  taking  healthcare  to  the  field 

•  Enhancing  and  measuring  the  health  and  fitness  of  the  force 

•  Modifying  the  total  Military  Health  Services  System  (MHSS)  staffing  model  to 
reduce  the  size  and  skill  mix  requirement  for  support  of  military  operations 

•  Increasing  the  efficiency  of  the  MHSS  staff  in  peacetime,  maintaining  military 
readiness  skills  of  the  MHSS  active  duty  staff,  and  reducing  the  health  service 
requirements  of  TRICARE  contractors 

In  addition, 

THE  ANALYSIS 

•  Analyze  current  AMEDD  and  AMEDD-led  telemedicine  initiatives  within  the  DOD 
Telemedicine  Testbed  Database  using  the  telemedicine  health  technology  assessment 
tool.  The  assessment  tool  will  incorporate  the  following  criteria  into  the  development 
methodology: 

•  Group  similar  AMEDD  and  AMEDD-led  telemedicine  initiatives  based  on 
obvious  relationships 
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•  Sequence  AMEDD  and  AMEDD-led  telemedicine  initiatives  by  rank  order  based 
on  value  derived  by  applying  the  criteria  described  above 

•  Analyze  initiatives  for  redundancy  and  identify  superior  AMEDD  and  AMEDD- 
led  telemedicine  initiatives  based  on  criteria  described  above 

•  Identify  existing  gaps  between  current  AMEDD  and  AMEDD-led  telemedicine 
initiatives  and  recommend  new  initiatives  to  accomplish  the  criteria  described 
above 

•  Analyze  the  merit  of  each  AMEDD  and  AMEDD-led  telemedicine  initiatives 
against  the  criteria  described  above 
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HEALTH  TECHNOLOGY  ASSESSMENT  TOOL 


4.1  ASSESSMENT  TOOL  DEVELOPMENT 

The  purpose  of  the  study  is  to  design  a  health  technology  assessment  tool 
(assessment  tool)  to  evaluate  the  effectiveness  of  current  AMEDD  and  AMEDD-led 
telemedicine  initiatives.  The  success  criteria,  given  by  the  Telemedicine  Board  of 
Directors  (TBOD),  are: 

•  Achieving  specific  telemedicine  initiative  project  objectives 

•  Keeping  active  duty  forces  on  the  job  and  taking  healthcare  to  the  field 

•  Enhancing  and  measuring  the  health  and  fitness  of  the  force 

•  Reducing  forward-deployed  medical  footprint  to  support  lightning  strike 
operations 

•  Modifying  the  total  Military  Health  Services  System  staffing  model  to 
reduce  the  size  and  skill  mix  requirement  for  support  off  military 
operations 

•  Increasing  the  efficiency  of  the  MHSS  staff  in  peacetime,  maintaining 
military  readiness  skills  of  the  MHSS  active  duty  staff,  and  reducing  the 
health  service  requirements  of  TRICARE  contractors 

In  order  to  meet  the  study’s  goals  and  objectives,  the  REL  team  1)  formulated 
objectives  to  determine  what  factors  were  critical  to  the  AMEDD  leadership  in  evaluating 
technologies,  2)  designed  a  health  technology  assessment  tool,  3)  piloted  the  data 
collection  process  in  TRICARE  Region  6  for  telemedicine,  and  4)  analyzed  the  results  to 
the  extent  data  was  available  for  technical,  operational,  economic  value  using  the 
Analytical  Hierarchy  Process  (AHP). 

The  REL  Health  Technology  Assessment  Tool  is  not  simply  a  set  of  questions 
(data  call)  or  a  computer  simulation  program  (decision  support  system);  It  is  a  process  by 
which  the  importance  of  various  factors  for  technology  investments  are  determined, 
selected,  implemented  and  evaluated.  The  process  is  based  on  the  Analytical  Hierarchy 
Process  described  more  fully  in  4.1.3.  Figure  1  shows  how  the  first  phase  of  this  study 
relates  to  overall  technology  forecast  and  investment  strategy  (business  plan). 


Figure  1  REL  Health  Technology  Assessment  Tool 
(which  show  where  the  1st  phase  fits  into  the  overall  process) 


4.1.1  CRITICAL  DETERMINANT  FACTORS 


Foremost  in  effective  decision-making  is  the  role  of  the  leadership.  The 
leadership  must  identify  and  agree  on  the  critical  factors  and  assign  them  a  weight 
in  order  to  make  quality  decisions.  To  deal  with  unstructured  social,  economic, 
and  political  issues,  we  need  to  order  our  priorities,  to  agree  that  one  objective 
outweighs  another  in  the  short-  or  long-term,  and  to  make  tradeoffs  to  serve  the 
greatest  common  interests. 

Although  the  ultimate  goal  of  the  assessment  tool  is  to  determine  future 
technology  investments,  factors,  other  than  those  in  the  technology  arena,  must 
also  be  examined.  Some  examples  of  these  non-technology  factors  include 
business  process,  cost-benefit-risk  tradeoffs,  and  ever-changing  operational 
environments.  In  the  present  case,  AMEDD  critical  factors  may  be  viewed  from 
three  different  perspectives:  military,  commercial,  and  medical  perspectives. 

MILITARY  PERSPECTIVE: 


From  the  military  perspective,  some  critical  factors  include  the  continual 
shrinkage  of  the  military  size.  Current  and  future  missions  will  be  diverse  and 
may  be  of  high  intensity,  short  duration,  and  battlespace  coverage.  Critical  cost- 
benefit  assessments  will  shape  the  future  military  force,  that  is,  the  use  of 
technology  to  replace  soldiers  on  the  battlefield. 

COMMERCIAL  PERSPECTIVE: 


From  the  commercial  perspective,  some  critical  factors  include  the  rapid 
incorporation  of  information  technology  into  the  industrial  backbone  in  all  market 
sectors.  High  consumer  demands  for  information  technology  along  with  short 
product  life  cycles  enhance  the  continued  and  unprecedented  pace  of  technology 
development.  Critical  cost-benefit-risk  analysis  will  again  shape  the  commercial 
area  as  continued  business  re-engineering  favors  technology  investments. 

MEDICAL  PERSPECTIVE: 


From  the  medical  perspective,  critical  factors  for  the  deployed,  beneficiary 
and  non-operational  forces  are  also  changing.  Some  of  these  factors  include  the 
wide  disbursement  of  combatants  along  with  the  limited  number  of  combat  troops 
which  mandates  the  optimization  of  soldier  performance  with  minimization  of 
down  time;  the  focus  on  treatments  that  allow  soldiers  to  continue  missions  with 
decremented  performance  level;  and  shifting  the  focus  from  treatment  in  theater 
to  stabilization  only  and  treatment  at  home.  The  shift  of  beneficiary  and  non- 
operational  healthcare  to  contractors,  along  with  the  introduction  of  contract 
healthcare  support  to  the  operational  environment,  also  affects  the  peacetime 
health  care  system. 
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AMEDD  recognizes  the  need  to  continue  to  leverage  each  investment  in 
order  to  maximize  returns.  In  the  AMEDD,  the  reduction  of  financial,  personnel 
and  facility  resources  emphasizes  AMEDD’ s  challenge  to  reflectively  develop 
and  field  complex  new  technologies  when  new  technologies  are  expensive  and 
sophisticated  R&D  may  also  be  required.  In  addition,  the  technology  product  life 
cycle  has  become  very  short  compared  to  traditional  DOD  timelines. 

In  summary,  the  factors  mentioned  above  are  examples  of  those  critical  to 
the  AMEDD  leadership  as  AMEDD  evaluates  current  and  future  technology 
investments. 


4.1.2  DECISION  MAKING  SYSTEM  TECHNIQUES 

According  to  Mason8,  a  necessary  condition  for  conceiving  of  something 
as  a  ‘system’  is  that  there  is  a  decision-maker  who  -  via  resources  -  can  produce 
changes. 


“In  organizations,  the  decision-making  function  is  the  responsibility  of 
management.  In  order  to  execute  its  responsibility,  an  organization’s 
management  requires  information  about  the  resources  available  to  it  and 
their  relative  effectiveness  for  achieving  the  organization”  purposes. 
Resources  are  acquired,  allocated,  motivated  and  manipulated  under  the 
manager’s  control.  They  include  people,  materials,  plant  and  equipment, 
money,  and  information9”. 

We  are  often  forced  to  deal  with  more  problems  than  we  have  resources  to 
handle.  To  operate  successfully,  industry  and  government  must  organize  their 
policies  on  the  basis  of  short-  and  long-term  thinking.  They  must  integrate  and 
synthesize  a  diversity  of  data  and  information.  They  need  to  deal  with  intangibles 
side  by  side  with  tangibles  that  have  different  scales10.  How  should  these  diverse 
scales  be  interpreted  for  decision  making?  Is  it  meaningful  to  mix  dollars,  tons, 
feet,  and  hours  directly.  If  so,  to  what  scale  should  they  be  converted  and  how  are 
they  combined  for  optimum  results. 

There  are  two  fundamental  approaches  to  solving  problems:  the 
“deductive”  approach  and  the  “systems”  approach.  Basically,  the  “deductive” 
approach  focuses  on  the  parts  and  the  “systems”  approach  focuses  on  the 
workings  of  the  whole. 


8  Mason,  Richard  and  Swanson,  E.  Burton,  “California  Management  Review,  Vol  21,  No.  3  (Spring  1979)  pp.  14 

9  Ibid. 

10  Saaty,  Thomas,  “Fundamentals  of  Decision  Making  and  Priority  Theory  with  the  Analytic  Hierarchy  Process,  Vol. 
VI,  1994,  RWS  Publications,  Pittsburgh,  PA,  pp.  3 
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Decisions  are  based  on  judgements  about  impressions  of  reality  which  are 
often  hazy.  Logic  is  then  used  to  defend  the  conclusions1 1 .  In  order  to  make 
resource  decisions  in  a  rational  way,  an  organization  needs  to  do: 

•  Identify/design  alternatives  (e.g.  alternative  R&D  projects,  or 
operational  plans  for  alternative  levels  of  funding  for  each  sub¬ 
organization) 

•  Identify  and  structure  the  organizational  goals  into  objectives,  sub¬ 
objectives,  and  so  on 

•  Measure  how  well  each  alternative  contributes  to  each  of  the 
lowest  level  of  (sub)  objectives 

•  Find  the  best  combination  of  alternatives,  subject  to  environmental 
and  organizational  constraints. 

The  Analytical  Hierarchy  Process  (AHP)  is  a  recognized  method  to 
combine  the  “deductive”  and  “system”  approaches  into  one  integrated,  logical 
framework12.  The  Analytical  Hierarchy  Process  organizes  feelings,  intuition,  and 
logic  in  a  structured  approach  to  decision  making.  AHP  serves  as  the  foundation 
for  the  health  technology  assessment  tool  and  the  software  package  chosen  for 
data  analysis  is  Expert  Choice™  Decision  Support  Software,  a  proven  operational 
research  tool  based  on  AHP. 

Before  examining  the  project  selection  models  in  detail  and  AHP,  two 
critically  important,  but  often  overlooked  facts  must  be  understood13: 

•  Models  do  not  make  decision;  people  do.  The  manager,  not  the 
model,  bears  the  responsibility  for  the  decision. 

•  All  models,  however  sophisticated,  are  only  partial  representations 
of  the  reality  they  meant  to  reflect.  Reality  is  far  too  complex  for 
us  to  capture  more  than  a  small  fraction  of  it  in  any  model. 

.  .  Therefore,  no  model  can  yield  an  optimal  decision  except  within 

V  '  its  own,  possibly  inadequate,  framework. 


11  Ibid. 

12  Saaty,  Thomas,  “Decision  Making  for  Leaders”,  1996  RWS  Publications,  Pittsburgh,  PA,  pp.  13 

13  Meredith,  Jack  R.,  Mantel,  Samuel  J.,  Project  Management:  A  Managerial  Approach,  Third  Edition,  1995,  John 
Wiley  &  Sons,  Inc.  pp.  43 . 
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4.1.3  UNDERSTANDING  THE  TOOL  -  ANALYTICAL  HIERARCHY 
PROCESS  (AHP)  METHOD 

OVERVIEW 


The  Analytic  Hierarchy  Process  was  developed  at  the  Wharton  School  of 
business  over  20  years  ago  by  Thomas  L.  Saaty  and  allows  decision  makers  to 
model  complex  problems  in  a  hierarchical  structure  showing  the  relationships  of 
the  goals,  objectives  (or  criteria),  (sub)  objectives,  and  alternatives.  First,  it  is 
useful  to  clarify  the  meaning  of  Analytic,  Hierarchy,  and  Process  used  in  AHP. 

Analytic 

Most  organizations  are  proficient  at  this  part  of  the  method,  that  is, 
to  analyze,  to  pull  apart  and  examine  the  individual  pieces.  Analytic  is  a 
form  of  the  word  analysis,  which  may  be  defined  as  “separating  into 
elemental  parts  or  basic  principles14.  Although  organizations  are  good  at 
analysis,  it  does  not  often  help  them  make  better  decisions.  In  order  to  use 
the  analysis,  the  key  is  to  synthesize  the  information,  which  involves 
combining  all  of  the  parts  into  a  whole.  Dr.  Ernest  H.  Forman  states,  “in  a 
sense,  AHP  should  really  be  called  Synthesis  Hierarchy  process  because  at 
its  core,  AHP  helps  us  measure  and  synthesize  the  multiple  factors 
involved  in  complex  decisions15.” 

Hierarchy 


Hierarchies  are  a  fundamental  tool  of  the  human  mind.  The  use  of 
hierarchies  involves  identifying  the  elements  of  a  problem,  grouping  the 
elements  into  homogeneous  sets,  and  arranging  these  sets  in  different 
levels.  Herbert  A.  Simon,  father  of  the  field  of  Artificial  Intelligence  and 
Nobel  laureate,  writes16: 

“Large  organizations  are  almost  universally  hierarchical  in 
structure.  That  is  to  say,  they  are  divided  into  units  which  are 
subdivided  into  smaller  units,  which  are,  in  turn,  subdivided  and  so 
on.  Hierarchical  subdivision  is  not  a  characteristic  that  is 
particular  to  human  organizations.  It  is  common  to  virtually  all 
complex  systems  of  which  we  have  knowledge. . .  The  near 
universality  of  hierarchy  in  the  composition  of  complex  systems 
suggest  that  there  is  something  fundamental  in  this  structure  that 
goes  beyond  the  peculiarities  of  human  organizations.  An 


14  Webser’s  II  New  Riverside  University  Dictionary,  1994,  Houghton  Mifflin  Company,  Boston,  MA,  pp.  104. 

15  Forman,  Ernest  H,  “Decision  by  Objectives”,  1997,  RWS  Publications,  Pittsburgh,  PA,  pp. 

16  Simon,  Herbert  A.,  “The  New  Science  of  Management  Decision”.,  Harper  and  Brothers,  New  York,  N.Y.,  1960. 
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organization  will  tend  to  assume  hierarchical  form  whenever  the 
task  environment  is  complex  relative  to  the  problem-solving  and 
communicating  powers  of  the  organization  members  and  their 
tools.  Hierarchy  is  the  adaptive  form  for  finite  intelligence  to 
assume  in  the  face  of  complexity. 

Hierarchies  can  be  divided  into  two  kinds:  structural  and 
functional17.  In  structural  hierarchies,  complex  systems  are  structured 
into  their  constituent  parts  in  descending  ordering  according  to  structural 
properties  such  as  size,  shape,  color,  age,  etc.  Structural  hierarchies  relate 
closely  to  the  way  our  brain  analyzes  complexity  by  breaking  down  the 
objects  perceived  by  ours  senses  into  clusters,  (sub)  clusters,  and  still 
smaller  clusters. 

In  contrast,  functional  hierarchies  decompose  complex  systems 
into  their  constituent  parts  according  to  their  essential  relationships.  A 
conflict  over  selection  of  a  new  site  for  an  Army  Community  Hospital  can 
be  structured  into  a  cluster  of  major  stakeholders  (the  troops,  the  AMEDD 
leadership,  Congress,  etc.),  a  cluster  of  stakeholder  objectives  (care  for 
patients,  best  location,  cost  of  construction,  etc.),  and  alternative  outcomes 
(selection  of  the  various  candidates).  Functional  hierarchies  help  people 
steer  a  system  towards  a  desired  goal  such  as  conflict  resolution,  efficient 
performance,  or  overall  happiness. 

Figure  2  shows  the  hierarchical  structure  of  the  AHP  model  for  the 
assessment  tool. 


LEVEL  I:  Goal 
LEVEL  II:  Objectives 
LEVEL  III:  (Sub)  Objectives 
LEVEL  IV:  Alternatives 


Figure  2  Structure  of  the  AHP  Health  Technology  Assessment 
Tool  for  Telemedicine 

(which  shows  the  hierarchical  structure  of  the  assessment  tool) 


17  Saaty,  Thomas,  “Decision  Making  for  Leaders”,  1995,  RWS  Publications,  Pittsburgh,  PA,  pp.  30 
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Process 


A  process  indicates  that  it  is  not  a  static  activity  but  allows  for 
changes,  as  new  information  is  available.  Iterations  are  needed  to  create  a 
meaningful  and  useful  tool.  Good  decision  making  is  also  an  iterative 
process. 

AHP  has  been  documented  in  over  1000  articles  and  doctoral 
dissertations18.  Some  users  around  the  world  include  IBM,  General  Motors, 
Xerox,  3M,  U.S.  Navy,  Rockwell  International,  and  NASA.  In  the  medical  area, 
AHP  publications  included  topics  such  as  clinical  decisions,  determination  of 
hospital  requirements,  priority  assignments,  and  selection  of  a  hospital19.  AHP 
has  demonstrated  application  in  the  areas  of  resource  allocation20,  technology 
management"  ’  ,  project  selection  ’  ,  and  cost-benefit  analysis  . 

Basically,  AHP  is  a  set  of  axioms  that  carefully  delimits  the  scope  of  the 
problem  environment.  It  is  based  on  the  well-defined  mathematical  structure  of 
consistent  matrices  and  their  associated  right-eigenvector’s  ability  to  generate  true 
or  approximate  weights.  The  AHP  methodology  compares  criteria,  or  alternatives 
with  respect  to  a  criterion  in  a  natural  pair-wise  mode.  To  do  so,  AHP  uses  a 
fundamental  scale  of  absolute  numbers  that  has  been  proven  in  practice  and 
validated  by  physical  and  decision  problem  experiments.  The  fundamental  scale 
converts  individual  preferences  into  ratio  scale  weights  that  can  be  combined  into 
a  linear  additive  weight  or  (a)  for  each  alternative  a.  The  resultant  ©(a)  can  be 
used  to  compare  and  rank  the  alternatives,  hence,  assist  the  decision-maker  in 
making  a  choice. 

The  steps  in  decision  making,  such  as:  assigning  priorities,  evaluating 
variables,  making  trade-off  evaluations,  and  integrating  multiple  points  of  view 
are  standard  and  easy  when  decisions  are  simple.  Unfortunately,  as  decisions 
become  more  complex  -  including  more  alternatives,  more  criteria  and  more 
variables  —  our  ability  to  mentally  manage,  relate  and  evaluate  all  of  the  elements 


18  http://www.ExpeitChoice.com 

19  Tummala,  R.,  Wan,  Y.W.,  Analytic  Hierarchy  Process  (AHP)  in  practice:  A  survey  of  applications  and  recent 
developments,  1993 

20  Bauer,  R.,  Collar,  E.,  Tang,  V.,  The  Silverlake  Project,  Transformation  at  IBM  Silverlake  Project:  Transformation 
at  IBM.  Oxford  University  Press,  New  York,  1992. 

21  Manahan,  M.O.,  Technology  acquisition  and  research  prioritization,  International  Journal  of  Technology 
Management,  1989,  4(1),  pp.  9-19 

22  Carter,  W.K.,  To  invest  in  new  technology  or  not?  New  tools  for  making  the  decision,  Journal  of  Accountancy, 
1992,  173(5),  pp.  58-64 

23  Calhoun,  J.  K.,  Automated  objectivity  for  subjective  business  decisions,  Information  Strategy:  The  Executive’s 
Journal,  1989,  6(1),  pp.  21-25 

24  Liberatore,  M.J.,  An  extension  of  analytic  hierarchy  process  for  industrial  R&D  project  selection  and  resource 
allocation,  IEEE  Transactions  on  Engineering  Management,  1987,  EM-34(1),  pp.  12-18 

25  Bennet,  J.P.  &  Saaty,  T.L.,  Knapsack  allocation  of  multiple  resources  in  benefit-cost  analysis  by  way  of  analytic 
hierarchy  process,  Mathematical  and  Computer  Modelling,  1993,  17(4-5),  pp.  55-72 
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deteriorate.  As  a  result,  the  focuses  of  decision-makers  are  usually  on  just  a  few 
factors,  weakening  the  ability  to  reach  the  best  overall  decisions. 

A  detailed  description  of  the  AHP  theory  is  included  in  Appendix  A.  A 
detailed  description  of  other  types  of  project  evaluation  and  selection  model  is 
included  in  Appendix  B.  These  descriptions  include  both  non-numeric  and 
numeric  models.  Other  operations  research  and  economics  models  are  described 
in  later  sections  of  this  report  including  6. 1.3. 7.  In  addition,  Figure  3  summarizes 
the  major  advantages  of  the  Analytic  Hierarchy  Process. 


Process  Repetition: 

The  AHP  enables  people  to 
refine  their  definitions  of  a 
problem  and  to  improve  their 
judgement  and  understanding 
through  repetition. 


Unity: 

The  AHP  provides  a  single, 
easily  understood,  flexible 
model  for  a  wide  range  of 
unstructured  problems. 


Com  plexity: 

The  AHP  integrates  deductive 
and  systems  approaches  in 
solving  complex  problems. 


Judgement  and  Consensus: 


The  AHP  does  not  insist  on 
consensus  but  synthesizes  a 
representative  outcome  from 
diverse  judgem  ents. 

T  radeoffs: 

The  AHP  takes  into  consideration 
the  relative  priorities  of  factors  in 
a  system  and  enables  people  to 
select  the  best  alternatives  based 
on  their  goals. 


Interdependence: 

The  AHP  can  deal  with 
interdependence  of  elements  in 
a  system  and  does  not  insist  on 
linear  thinking. 

Hierarchic  Structuring: 

The  AHP  reflects  the 
tendency  of  the  mind  to  sort 
elements  of  a  system  into 
different  levels  and  to  group  like 
elements  in  each  level. 


Synthesis: 

The  AHP  leads  to  an 
overall  estimate  of 
the  desirability  of 
each  alternative. 


I  Measurement: 

The  AHP  provides  a  scale  for 
measuring  intangibles  and  a 
Consistency:  method  for  establishing 

The  AHP  tracks  the  logical  Priorities, 

consistency  of  the  judgements 
used  in  determining  priorities. 


Figure  3  Advantages  of  the  Analytic  Hierarchy  Process26 
(which  shows  the  various  advantages  of  AHP) 


4.3.1. 1  Development  of  Goal,  Objectives  and  (Sub)  Objectives 

LEVEL  1:  GOAL 


The  first  step  in  the  development  of  an  AHP  is  to  define  the 
goal.  This  is  the  responsibility  of  the  leadership.  It  is  important  to 
take  time  to  do  this  well.  Mission  statements,  purposes,  scope, 
objectives,  and  goals  are  related  and  often  confused  or  used 
interchangeably.  Mission  statement  and  purposes  are  most  alike  in 
meaning  and  can  be  considered  at  the  top  of  a  hierarchy  of 
planning.  Although  goals  and  objectives  are  similar  in  meaning,  in 
AHP,  the  goal  closely  aligns  with  the  broader  meaning  of  the 
mission  and  purpose  while  objectives  are  used  with  greater 


26  Saaty,  Thomas  L.,  Decision  Making  for  Leaders,  1996,  RWS  Publications,  pp.  25 
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specificity  and  define  what  happens  when  the  mission  is 
completed. 

LEVEL  II:  OBJECTIVES/CRITERION 


A  hierarchy  can  be  constructed  to  represent  the  complex 
problem  in  a  multilevel  structure  whose  first  level  is  the  goal 
followed  successively  by  levels  of  objectives,  criteria,  (sub) 
criteria,  and  so  on  down  to  a  bottom  level  of  alternatives.  The 
objective  of  a  hierarchy  is  to  assess  the  impact  of  the  elements  of  a 
higher  level  on  those  of  a  lower  level  or  alternatively  the 
contribution  of  elements  in  the  lower  level  to  the  importance  or 
fulfillment  of  the  elements  in  the  level  above.  This  process  is  not 
necessarily  linear  but  may  involve  functional  independence. 


For  clarification,  our  operational  definition  of  the  ‘best’  choice  is  a 
rational  or  best  choice  that  best  meets  the  objective(s).  For  example,  in 
making  a  choice  between  a  large  and  small  car,  we  consider  the  attribute 
‘size’  of  the  car,  or  use  ‘size’  as  a  criterion.  We  run  into  difficulty  when 
trying  to  assess  whether  the  large  car  is  more  preferable  than  the  small  car, 
since  size  has  both  pros  and  cons.  Instead  of  considering  size  as  an 
attribute  or  criterion,  we  can  focus  on  the  objectives.  For  example,  the 
first  objective  is  safety.  With  respect  to  safety,  the  large  car  is  more 
preferable.  With  respect  to  the  second  objective  handling,  the  small  car  is 
more  preferable.  Therefore,  in  selection  of  the  ‘best’  telemedicine 
projects,  multiple  objectives  such  as  size,  ease  of  use,  and  reliability  and 
quality  of  care  are  considered.  The  Telemedicine  Profile,  which  appears  in 
Appendix  G,  was  used  to  collect  data  and  to  determine  the  level  of 
importance  the  various  objectives  are  to  the  AMEDD  leadership  and  the 
user  community. 

In  practice,  there  is  no  set  procedure  for  generating  the  objectives, 
hierarchies,  and  activities  (or  initiatives)  to  be  included  in  a  hierarchy.  It 
is  a  matter  of  what  objectives  we  choose  to  decompose  the  complexity  of 
the  problem27.  A  useful  criterion  to  check  the  validity  of  a  hierarchy  is  to 
determine  if  the  elements  of  an  upper  level  can  be  used  as  common 
attributes  to  compare  the  elements  in  the  level  immediately  below  with 
each  other.  A  valuable  observation  about  hierarchical  approach  to 
problem  solving  is  that  the  functional  representation  of  a  system  may 
differ  from  person  to  person,  but  people  tend  to  agree  on  the  bottom  level 
of  alternative  actions  to  be  taken  and  the  level  above  it28. 


27  Saaty,  Thomas,  “Fundamentals  of  Decision  Making  and  Priority  Theory  with  the  Analytic  Hierarchy  Process”,  pp. 


105-106 
28  Ibid. 
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4. 1.3.2  Constructing  Hierarchies 


As  mentioned  above,  hierarchies  can  be  divided  into  two  kinds: 
structural  and  functional.  In  our  case,  a  functional  hierarchy  is  more 
appropriate  since  the  objective  of  a  functional  hierarchy  is  to  help  steer 
people  towards  an  overall  objective  or  goal.  The  overarching  goal  of  the 
health  technology  assessment  tool  for  telemedicine  is  to  allocate  resources 
to  the  telemedicine  initiatives.  There  are  two  ways  to  build  an  AHP  model: 
the  top-down  and  the  bottoms-up  method. 

Top-Down  Construction 

In  the  top-down  approach,  the  numbers  and  types  of 
alternatives  are  open  and  one  attempts  to  find  a  best  choice  from 
what  is  available  at  the  time.  This  method  is  used  when  the 
objectives  and  (sub)  objectives  are  easily  definable.  For  example, 
the  top-down  approach  was  used  in  allocating  the  overall  financial 
resources  among  the  5  TBOD  stated  telemedicine  criteria 
(objectives).  This  is  a  type  of  evaluation  and  choice  (EC)  model 
that  results  in  a  set  of  weights  or  proportional  values  which 
indicate  the  proportional  allocation  of  resources  in  relation  the  five 
stated  objectives.  For  example,  if  the  weights  were  equal  for  all  5 
TBOD  objectives,  i.e.  0.2  each,  and  the  total  financial  resource 
pool  was  $100M,  all  projects  that  meet  the  peacetime  objective 
would  total  up  to  20%  of  $100M,  i.e.  $20M. 

Bottoms-Up  Construction 

In  the  bottoms-up  process,  the  alternatives  are  known, 
generally  exhaustive  and  one  wants  to  choose  a  best  one  or  allocate 
resources  among  them.  A  common  ‘formal’  approach  to  making 
choices  among  alternative  is  to  list  the  pros  and  cons  of  each 
alternative.  The  result  is  the  evaluation  of  the  factors  that  are 
useful  in  the  definition  and  identification  of  the  organization’s 
objectives.  The  bottoms-up  approach  is  used  to  evaluate  the 
alternatives  and  to  allocate  resources  among  them. 


4.1.3.3  Pair-wise  Comparisons  and  Synthesis 

Once  the  hierarchy  is  constructed  with  the  goals,  objectives,  (sub) 
objectives,  criterions,  (sub)  criterions,  and  alternatives,  AHP  method 
derives  ratio  scales  of  relative  magnitudes  of  a  set  of  elements  by  making 
paired  comparisons.  The  comparisons  proceed  from  judgements  on 
comparisons  with  respect  to  dominance,  which  is  the  generic  term  for 
expressing  importance,  preference  or  likelihood,  of  a  property  which  they 


Page  15 


have  in  common,  to  their  numerical  representation  according  to  the 
strength  of  that  domi  nance  and  then  derives  a  ratio  scale.  Thus,  decision 
making  with  AHP  is  based  on  ranking  activities  in  terms  of  relative  ratio 
scales  .  These  judgements  may  be  made  using  either  a  verbal,  graphic  or 
numeric  method  by  either  in  person  or  via  questionnaires. 

With  tangible  attributes,  we  use  our  instruments  and  senses  to 
estimate  how  the  objects/activities  differ  with  respect  to  dominance.  With 
intangible  attributes,  we  must  use  our  feelings  and  experience  to  make 
such  comparisons.  Humans  have  the  intrinsic  ability  of  consciousness  to 
make  comparisons  based  on  feelings  and  experiences.  Both  tangibles  and 
intangibles  can  be  used  to  create  a  ratio  scale  of  absolute  numbers,  which 
represent  their  strengths. 

The  misuse  of  numbers  is  one  reason  that  numerical  analyses  are 
sometimes  flawed.  In  order  to  avoid  such  errors,  levels  of  measurement 
are  reviewed  in  Appendix  B.  The  four  classifications  given  by  R.  S. 
Stevens  are  the  nominal,  ordinal,  interval  and  ratio  scales30.  The  health 
technology  assessment  tool  is  based  on  ratio  scales. 


4.1.3.4  Channel  Capacity  and  Short-term  Memory 

Experiments  have  proven  time  and  time  again  that  the  human  brain 
is  limited  in  both  its  short-term  memory  capacity  and  its  discrimination 
ability  (channel  capacity)  to  about  seven  things. 

According  to  James  Martin  ,  if  a  person  “has  to  choose  between  a 
range  of  20  alternatives,  he  will  give  inaccurate  answers  because  the  range 
exceeds  the  bandwidth  of  his  chamiel  for  perception.  In  many  cases, 
seven  alternatives  are  the  approximate  limit  of  his  channel  capacity”. 
Martin’s  conclusions  are  based  on  the  results  of  numerous  psychological 
experiments,  including  the  well  know  study  “The  Magical  Number  Seven, 
plus  or  minus  Two:  Some  Limits  on  Our  Capacity  for  Information 
Processing,”  by  G.  A.  Miller.32 

As  mentioned  in  4.1.3,  Herbert  A.  Simon,  the  1978  Nobel  Laureate 
in  Economics,  the  founding  father  of  artificial  intelligence,  stated  that 
most  of  our  decisions  are  based  on  short-term  memory.  A  maximum  of 


29  Ibid.,  pp.  8 

30  Stevens,  S.  S.  ,“On  the  Theory  of  Scales  of  Measurement”,  Science,  (103,  1946),  pp.  677-680. 

31  Martin,  James,  Design  of  Man-Computer  Dialogues,  (Englewood  Cliffs,  New  Jersey:  Prentice-Hall,  Inc.,  1973). 

32  Miller,  G.  A.,  “The  Magical  Number  Seven,  Plus  or  Minus  Two:  Some  Limits  on  Our  Capacity  for  Information 
Processing.”  Psychological  Review,  (Vol.  63,  No.  2,  March  1996),  pp.  81-97.  The  distribution  is  a  bell  shaped 
curve  with  an  average  of  7.  Only  about  1 1  percent  of  the  population  can  recall  9  things  from  their  short-term 
member,  still  fewer  at  1 0  things,  and  so  on. 


Page  16 


TO 

seven  pieces  of  information  is  used  in  making  decisions  .  However,  most 
people  use  only  three  to  four  on  the  average. 


4.1.3.5  Consistency 

The  AHP  model,  unlike  an  unweighted  or  weighted  linear  model, 
does  not  demand  perfect  consistency  and  allows  for  inconsistencies.  AHP 
also  provides  a  measure  of  the  inconsistency  in  each  set  of  judgements. 
The  real  world  is  hardly  consistent  but  it  is  natural  for  humans  to  want  to 
be  consistent.  An  inconsistency  ratio  of  about  1 0%  or  less  is  usually 
considered  ‘acceptable’.  An  inconsistency  ratio  of  100%  is  equivalent  to 
random  judgements.  The  most  common  causes  of  inconsistency  includes: 

•  Clerical  Error  (most  common  cause) 

•  Lack  of  information 

•  Lack  of  concentration  during  the  judgement  process 

•  Lack  of  consistency  in  whatever  is  being  modeled 

•  Inadequate  model  structure 

It  is  important  that  low  consistency  not  become  the  goal  of  the 
decision  making  process.  A  low  consistency  is  necessary  but  not 
sufficient  for  a  good  decision. 


4. 1.3.6  Evaluation  and  Choice34 

The  decision-maker's  judgments  form  the  basis  of  the  Evaluation 
and  Choice  (EC)  process.  Judgments  are  made  about  pairs  of  elements 
relevant  to  a  criterion  or  property,  which  they  have  in  common.  For 
example,  we  look  at  two  stars  and  notice  that  the  first  star  is  brighter  than 
the  second  star.  In  addition  to  observing  this,  we  have  the  ability  to  say 
that  the  first  star  is  much  brighter  than  the  second  star,  or  just  moderately 
brighter,  or  that  the  brightness  of  the  two  stars  is  the  same.  It  is  from  a 
multiplicity  of  these  pair-wise  comparisons  that  we  build  our  knowledge 
of  the  variability  of  a  criterion  that  interests  us. 

Just  as  we  can  distinguish  and  measure  physical  quantities  such  as 
meters  for  length  or  seconds  for  time,  we  are  able  to  do  the  same  with  our 
perceptions  of  other  qualities.  We  have  the  capacity  to  experience  a  wide 
range  of  feelings  and  discriminations.  This  permits  us  to  develop 
relationships  among  the  elements  of  a  problem  and  to  determine  which 
elements  have  the  greatest  impact. 

33  Simon,  Herbert  A. ,  Theories  of  Decision-Making  in  Economics  and  Behavioral  Science,  The  American 

Economic  Review,  Vol.  49,  No.  3,  (June,  1959),  pp.  253-283. 

34  Expert  Choice™  Tutorial  Version  9.0,  Expert  Choice  Decision  Support  Software,  Pittsburgh,  PA  1995. 
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There  are  three  ways  to  enter  pair-wise  comparisons  in  Evaluation 
and  Choice:  the  Verbal  mode,  the  Numerical  mode  (numerical  matrix  or 
questionnaire),  and  the  Graphical  mode.  One  can  express  the  relative 
importance  of  one  element  over  another  with  respect  to  a  given  criterion 
either  verbally  or  numerically.  When  making  comparisons  in  a  social, 
psychological,  or  political  context,  the  VERBAL  comparison  mode  of 
Evaluation  and  Choice  may  be  preferred.  When  comparing  economic  or 
other  measurable  factors,  the  NUMERICAL  comparison  mode  may  be 
preferred.  Table  1  explains  both  scales  and  their  relationship  used  in  the 
assessment  tool. 


Intensify  of 
Importance 

Definition 

Explanation 

1 

Equal  importance 

Two  activities  contribute  equally 
to  the  objective 

2 

Weak 

3 

Moderate  importance 

Experience  and  judgement  slightly 
favor  one  activity  over  another 

4 

Moderate  plus 

5 

Strong  importance 

Experience  and  judgement 
strongly  favor  one  activity  over 
another 

6 

Strong  plus 

7 

Very  strong  or 
demonstrated 

An  activity  is  favored  very 
strongly  over  another:  its 

importance 

dominance  demonstrated  in 
practice 

8 

Very,  very  strong 

9 

Extreme  importance 

The  evidence  favoring  one  activity 
over  another  is  of  the  highest 
possible  order  of  affirmation 

Reciprocals 
Of  above 

If  activity  i  has  one  of 
the  above  nonzero 
numbers  assigned  to 
it  when  compared 
with  activity  j,  then  j 
has  the  reciprocal 
value  when  compared 
with  i. 

Rationals 

Ratios  arising  from 
the  scale 

If  consistency  were  to  be  forced  by 
obtaining  n  numerical  values  to 
span  the  matrix 

Table  1  The  Fundamental  Scale  used  in  the  assessment  tool 
(which  defines  the  intensity  of  importance  of  the  fundamental  scale) 
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Synthesis  is  the  process  of  weighting  and  combining  priorities 
throughout  the  model  that  leads  to  the  overall  results.  Synthesis  from  the 
goal  node  multiplies  the  weight  of  each  parent  node  times  the  local 
priorities  of  its  children  nodes  and  of  those  children  times  the  local 
priorities  of  their  children.  This  process  continues  down  to  and  including 
the  alternatives. 

Synthesis  converts  all  the  local  priorities  into  global  priorities 
throughout  the  model,  the  object  being  to  obtain  global  weights  for  the 
alternatives.  The  global  weights  for  each  alternative  are  summed  to  get  its 
final  synthesized  weight,  or  overall  priority.  A  sensitivity  analysis  may 
then  be  performed  to  determine  how  sensitive  the  result  is  to  changes  in 
the  priority  of  the  criteria. 


4.1.3.7  The  Ratings  Method35 

The  ratings  method  combines  the  power  of  the  hierarchy  and  pair¬ 
wise  comparison  process  with  the  capability  to  rate  hundreds  of 
alternatives.  The  model  enables  decision-makers  to  easily  evaluate  a  large 
number  of  alternatives.  Ratings  should  only  be  used  when  decision¬ 
makers  have  a  thorough  understanding  of  their  objectives  and  can  thereby 
generate  meaningful  scales,  for  rating  alternatives,  under  the  objectives 
and  (sub)  objectives.  These  scales  may  be  relative  or  absolute  scales. 

After  a  panel  review  of  each  telemedicine  initiative  and  data 
presentation,  the  health  technology  assessment  tool  using  AHP  can 
generate  ratings  for  each  initiative.  The  rating  method  for  decision 
modeling  is  used  to  compare  alternatives  against  the  same  standards. 

These  standards  appear  under  the  lowest  level  (sub)  criteria  at  the  bottom 
of  the  model.  They  are  nodes  that  we  refer  to  as  intensities.  The  scale  of 
intensities  for  each  criterion  (objective  or  (sub)  objective)  is  then  used  to 
evaluate  each  alternative.  The  scores  for  each  alternative  are  weighted 
according  to  the  priorities  derived  from  the  pair-wise  comparison  process 
and  then  summed  to  determine  the  overall  score.  A  preliminary  scale  of 
intensities  for  our  telemedicine  case  is  shown  in  Appendix  E. 


4.1.3.8  Resource  Allocation  Methods 

COST-BENEFIT  ANALYSIS  OR  (BENEFIT/COST  RATIOS  OR 
B/C  RATIOS) 

One  of  the  most  widely  used  approaches  to  resource  allocations 
is  cost-benefit  analysis.  Organizations  have  used  cost-benefit 

35  Expert  Choice™  Tutorial  Version  9.0,  Expert  Choice  Decision  Support  Software,  Pittsburgh,  PA  1995. 
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analysis  for  quite  some  time.  Given  the  benefits  and  costs,  the  B/C 
ratios  may  be  easily  calculated  by  numeric  division.  Such  studies 
have  often  faltered  because  of  the  difficulty  in  quantifying  benefits. 
Costs  were  much  easier  to  quantify.  For  example,  in  choosing  a 
car,  we  may  consider  both  performance  and  maintenance 
requirements  as  objectives.  The  former  is  clearly  a  benefit  and  the 
later  a  cost.  When  we  compare  alternative  cars  with  respect  to 
these  objectives,  we  ask  which  car  is  more  preferable.  A  high 
performing  car  is  more  preferable  than  a  low  performing  car.  A 
car  requiring  low  maintenance  is  more  preferable  than  one 
requiring  high  maintenance. 

The  assumption  is  that  an  organization  will  consistently  follow 
the  philosophy  of  maximizing  its  cumulative  B/C  ratio.  Over  time, 
the  organization  will  also  maximize  their  benefits.  Although  this  is 
usually  true,  there  are  exceptions. 

Instead  of  including  benefits  and  costs  in  a  single  hierarchy,  a 
cost-benefit  approach  can  be  taken  in  which  one  hierarchy  is  used 
to  measure  the  benefits  of  the  alternatives,  and  a  second  hierarchy, 
used  to  measure  the  costs  of  the  alternative.  The  benefit  priorities 
are  similar  only  in  that  they  have  the  same  alternatives.  The 
benefit  priorities  from  the  benefits  hierarchy  are  subsequently 
divided  by  the  cost  priorities  from  the  cost  hierarchy  to  give  a 
measure  of  the  benefit/cost  ratio.  This  is  mathematically 
meaningful  because  each  hierarchy  produces  ratio  scale  priorities 
and  the  ratio  of  ratio  scale  numbers  is  a  ratio  scale.  The  flexibility 
of  separating  benefit  and  cost  allows  for  comparison  between 
resource  allocation  methods  such  as  cost-benefit,  cost-benefit-risk, 
optimization  of  benefits,  etc. 

Optimization  of  Benefits 

Another  method  for  allocating  resources  seeks  to  find  the  best 
combination  of  projects  or  activities  that  maximizes  the  total 
benefit  without  exceeding  the  budget.  This  is  the  goal  of  the  health 
technology  assessment  tool.  Compared  with  some  ambiguity  of 
what  maximizing  the  cumulative  benefit/cost  ratio  may 
accomplish,  the  objective  of  maximizing  benefits  is  straight 
forward,  understandable,  and  does  not  depend  on  questionable 
underlying  assumptions. 

Some  problems  can  be  made  more  complex  by  introducing 
other  constraints  other  than  cost  such  as  size,  weight,  and  time. 
Constraints  such  as  must  fund  projects  may  also  be  incorporated 


into  the  model.  In  addition,  positive  and  negative  synergistic 
constraints  may  also  be  represented. 

The  benefit  of  the  optimization  approach  to  resource  allocation 
is  flexibility.  Constraints  may  be  added  to  fit  almost  any 
managerial  need.  Management  may  obtain  an  ‘efficiency  frontier’ 
by  plotting  the  total  benefits  against  a  range  of  funds.  The 
decision-maker  may  examine  this  efficient  frontier  and  decides 
which  point  is  most  desirable. 

Comparison  between  B/C  Ratio  and  Optimization  of  Benefits: 

B/C  Ratios: 

Cost  is  an  objective  because  it  goes  into  B/C  Ratio 

-  If  Cost  (or  unexpended  funds)  is  not  an  objective,  then 
B/C  should  not  be  used. 

-  Pros:  Easy  to  Solve. 

-  Cons:  Can  lead  to  wrong  answers  if  applied  blindly 
(assumptions  are  difficult  to  verify) 

Can  only  deal  with  one  constraint 

Optimization  of  Benefits: 

Cost  may  or  may  not  be  an  objective 

If  cost  is  an  objective,  then  can  include  cost  an 

objective  in  the  hierarchy 

-  If  not,  cost  may  be  considered  as  a  constraint  and 
optimize  benefits  over  a  range  of  total  cost  constraint 
values;  or  add  percentage  of  unused  budget  as  variable 
in  optimization  the  objective  function. 

-  Pros:  Easy  to  verify  assumptions  can  include  many 
types  of  constraints,  very  flexible. 

-  Cons:  may  have  to  explain  why  replacing  a  higher 
B/C  alternative  with  a  more  costly  but  lower  B/C 
alternative  as  budget  is  increased,  is  in  the  best 
interest  of  the  organization. 

Comparison  of  results  from  maximizing  B/C  Ratios  and 
maximizing  benefits: 

-  Results  are  often  quite  close 

-  Identical  results  if  budget  limit  corresponds  to  a 
cumulative  cost  break  value 

-  Drastically  different  result  are  possible,  especially  in 
situations  where  cost,  or  unexpended  funds  are  not 
important 
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Activity  Level  Resource  Allocation 


In  discrete  alternative  resource  allocation,  each  alternative 
is  discrete  from  the  other  alternatives.  In  activity  level  resource 
allocation  one  or  more  levels  of  funding  are  considered  for  each 
alternative.  For  example,  each  project  in  an  organization  can  be 
considered  for  funding  at  current  levels,  +/- 5%,  +/-10%,  etc.  A 
plan  is  developed  specifying  the  type  and  extent  of  the  activities 
each  project  would  perform  at  each  level  of  funding.  AHP  models 
may  be  constructed  to  value  the  expected  contribution  to  the 
organization’s  objectives  for  each  alternative  level  of  funding.  The 
health  technology  assessment  tool  is  capable  of  performing  activity 
level  resource  allocation. 


4.2  EXPERT  CHOICE™  DECISION  SUPPORT  SOFTWARE 

The  assessment  tool  decision  support  system  used  to  analyze  the  data  collected  is 
a  proven  operational  research  tool,  Expert  Choice™  Decision  Support  Software.  AHP 
forms  the  basis  for  the  software  by  providing  a  logical,  easy-to-use  framework  which  all 
the  elements  of  a  decision  can  be  defined,  organized,  and  carefully  evaluated. 

The  Expert  Choice™  software  allows  the  users  to  first  define  the  decision 
problem  as  the  goal,  and  structure  the  problems  as  levels  of  criteria  or  objectives  within  a 
hierarchical  framework.  Once  these  factors  have  been  determined,  the  alternatives  are 
placed  at  the  bottom  level  of  the  hierarchy  under  each  lowest  level  of  (sub)  criterion.  The 
flexibility  of  the  hierarchic  structure  allows  the  user  to  build  models  specific  to  the 
problem36.  Expert  Choice™  leads  the  decision-maker  through  a  series  of  judgements 
between  the  alternatives  under  each  criterion,  and  then  between  the  criteria. 

The  judgement  process  can  be  based  on  importance,  preference,  or  likelihood. 
Expert  Choice™  provides  four  types  of  comparison  modes:  verbal,  numeric,  graphical, 
and  questionnaire.  Data  can  be  directly  entered  into  the  model.  The  verbal  mode  allows 
the  user  to  pair-wise  compare  the  elements  on  a  nine-level  scale  with  levels  ranging  from 
“equal”  to  “extreme”.  The  decision-maker  represent  the  preference  in  matrix  mode  with 
“A”  preferred  over  “B”  and  in  graphical  mode  by  adjusting  a  bar  chart.  Through  the  pair¬ 
wise  comparison  process,  Expert  Choice™  derives  the  priorities  and  combines  all  the 
priorities  to  arrive  at  an  overall  ranking  of  the  alternatives.  In  addition,  sensitivity 
analysis  can  be  performed  to  determine  how  changes  to  one  or  more  judgement  weights 
affect  the  final  priorities. 


36  Expert  Choice™  Tutorial  Version  9.0,  Expert  Choice  Decision  Support  Software,  Pittsburgh,  PA  1995,  pp.  ii 
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4.3  GROUP  DECISION  MAKING 


Often,  important  decisions  today  are  not  made  by  a  single  individual  but  by 
groups  of  people  such  as  technical  experts,  organization  managers,  or  stakeholders.  This 
is  certainly  the  case  in  the  development  of  complex  initiatives  like  those  AMEDD  must 
address.  TeamEC  for  Windows™  is  a  decision-support  software  tool  designed 
specifically  to  help  groups  enhance  the  quality  of  their  decisions  by  bringing  structure  to 
their  decision  making  process37.  Based  on  the  Analytic  Hierarchy  Process  (AHP) 
decision-making  methodology,  TeamEC  helps  group  members  define  the  objectives, 
goals,  criteria  and  alternatives  and  then  organize  them  into  a  hierarchical  structure.  Using 
hand-held  radio  keypads  for  voting,  participants  compare  and  prioritize  the  relative 
importance  of  the  decision  variables.  TeamEC  then  synthesizes  the  groups'  judgments  to 
arrive  at  a  conclusion  and  allows  you  to  examine  how  changing  the  weighting  of  the 
criteria  affects  the  outcome. 


Appendix  C  shows  an  excerpt  from  Kirti  Srisoepardani’s  Ph.D.  dissertation 
comparing  the  various  group  decision-making  methods.  AHP  is  a  structuring  and 
measuring  method  and  rates  high  to  very  high  in  all  except  one  category  (scope  of 
problem  abstraction).  The  methods  evaluated  in  this  excerpt  include: 


Structuring 
Analogy,  Association 
Boundary  Examination 
Brainstorming/Brainwriting 
Morphological  Connection 
Why- What’s  Stopping 

Structuring  and  Measuring 
Bayseian  Analysis 
MAUT/MAVT 

AHP 


Order  and  Ranking 
Voting 

Nominal  Group  Techniques 
Delphi 

Disjointed  Incrementalism 
Matrix  Evaluation 
Goal  Programming 
Conjoint  Analysis 
Outranking 


37  http://www.expertchoice.com/ 
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5. 


AMEDD’S  TELEMEDICINE  INTIATIVES  AND  THE  ANALYTICAL 
HIERARCHY  PROCESS  (AHP)  IN  PRACTICE 


5.1  EVALUATION  AND  CHOICE  (EC)  MODEL  CONFIGURATION 

5.1.1  LEVEL  I:  GOAL 

Since  the  purpose  of  the  study  is  to  analyze  and  prioritize  current  AMEDD 
and  AMEDD-led  telemedicine  initiatives,  the  goal  of  the  health  technology 
assessment  tool  may  be  stated  as: 

•  GOAL:  Allocate  resources  to  telemedicine  initiatives  (or  projects) 

5.1.2  LEVEL  II:  OBJECTIVES 

The  second  level  of  the  AHP  model  is  the  statement  and  weighting  of  the 
objectives.  The  key  objectives  for  allocation  of  telemedicine  resources  given  by 
the  Telemedicine  Board  of  Directors  (TBOD)  are: 

•  Achieving  specific  telemedicine  initiative  project  objectives 

•  Keeping  active  duty  forces  on  the  job  and  taking  healthcare  to  the 
field 

•  Enhancing  and  measuring  the  health  and  fitness  of  the  force 

•  Modifying  the  total  Military  Health  Services  System  staffing 
model  to  reduce  the  size  and  skill  mix  requirement  for  support  of 
military  operations 

•  Increasing  the  efficiency  of  the  MHSS  staff  in  peacetime, 
maintaining  military  readiness  skills  of  the  MHSS  active  duty  staff, 
and  reducing  the  health  service  requirements  of  TRICARE 
contractors. 

The  first  type  of  model  is  the  evaluation  and  choice  (EC)  model  to  assist 
decisions-makers  in  the  allocation  of  resources  to  each  of  the  above  objectives. 


5.1.3  LEVEL  III:  (SUB)  OBJECTIVES 

After  market  analysis,  literature  review  and  brainstorming,  the  REL  team 
developed  a  preliminary  list  of  (sub)  objectives  that  are  important  in  telemedicine 
resource  allocation.  The  objectives  and  brief  description  of  each  are  listed  below. 
The  (sub)  objectives  are  divided  into  three  categories:  benefit,  cost,  and  risks.  In 
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addition,  the  (sub)  objectives  are  further  divided  into  three  areas:  technical, 
business,  delivery  of  care  (care). 


5.2  BENEFIT  OBJECTIVES 

5.2.1  TECHNICAL  OBJECTIVES 

•  Compatibility  (COMPATIBL)  -  Compatibility  of  system  with  existing 
information  systems 

•  Multiple  Usage  (MULT_USE)  -  Multiple  uses  of  the  same  equipment 

•  Reliability  (RELIABLE)  -  Reliability  of  the  system 

•  Performance  (PERFORM)  -  Performance  level  of  the  system 

•  Standards  (STANDRDS)  -  Meeting  the  established  standards 
(transmission,  records,  etc.)  such  as  HL7,  DICOM,  TCP/IP,  H32X, 
etc. 

•  Speed  (SPEED)  -  Speed  of  transmission  (available  bandwidth) 

•  Upgrade  (UPGRADE)  -  Ease  of  system  upgrades 

5.2.2  BUSINESS  OBJECTIVES 

•  Ease  of  Use  (EASE  USE)  -  Ease  of  use  of  the  system 

•  Integration  (INTEGRTE)  -  Integration  with  existing  IM/IS 
infrastructure 

•  Market  penetration  (MARKETP)  -  Market  penetration  (use  of 
technology/total  number  of  uses) 

•  Measures  of  Performance  (MOP)  -  Does  the  initiatives  have  clearly 
written  measures  of  performance? 

•  Patient  (PATIENT)  -  Primary  patient  population 

•  Political  (POLITICAL)  -  The  political  support  for  the  initiative 

•  Plan  (PLAN)  -  Does  the  initiative  have  a  written  business  or  project 
management  plan? 

•  Usage  Level  (USGE_LVL)  -  The  level  of  system  usage 
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5.2.3  DELIVER  OF  CARE  (CARE)  OBJECTIVES 

•  Approvals  (APPRO VL)  -  Approval  of  system  by  review  board(s) 
and/or  FDA 

•  Efficiency  (EFFICNCY)  -  Efficiency  in  the  delivery  of  care 

•  Quality  (QUALITY)  -  Quality  of  care 

•  Safety  (SAFETY)  -  Safety  of  equipment/procedure 

•  Satisfaction  (SATISF)  -  Patient  (or  student)  satisfaction  level  with 
procedure/system/technology 

•  Security  (SECURE)  -  Patient  privacy,  information  security  and 
confidentiality 

5.3  COST  OBJECTIVES 

5.3.1  TECHNICAL  OBJECTIVES 

•  Maintenance  (MAINTAIN)  -  Maintenance  requirements  of  the  system 

•  Size  (SIZE)  -  Size  of  the  equipment 

•  Weight  (WEIGHT)  -  Weight  of  the  equipment 

•  Assembly  (ASSEMBLY)  -  Level  of  difficulty  in  assembling  the 
equipment 

•  Customization  (CUSTOM)  -  Customization  level  of  the  equipment 

5.3.2  BUSINESS  OBJECTIVES 

•  Initial  Capital  Requirements  (ICAPITAL)  -  Initial  capital  investments 

•  On-going  Capital  Requirements  (OCAPITAL)  -  On-going  monthly 
capital  investments 

•  Training  (TRAINING)  -  Initial  system  training  requirements 

•  Facility  (FACILITY)  -  Facility  requirements 
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Scheduling  (SCHEDUL)  -  Scheduling  requirements 
Transmission  Cost  (TRANS$)  -  Monthly  transmission  costs 


5.3.3  DELIVERY  OF  CARE  (CARE)  OBJECTIVES 

•  Clinician  Inconveniences  (CJNCONV)  -  Level  of  clinician 
inconvenience 

•  Confinement  (CONFINE)  -  Patient  confinement  requirement  (in 
room,  in  machine,  etc.) 

•  Patient  Delays  (DELAY)  -  Patient  delays  before,  during,  or  after  the 
TMED  session 

•  Patient  Discomfort  (DISCMFT)  -  Level  of  patient  discomfort 

•  Patient  Inconveniences  (P_INCONV)  -  Level  of  patient  inconvenience 

•  Patient  Movement  (MOVEMNT)  -  Required  patient  movement 


5.4  RISK  OBJECTIVES 

•  Technical  (TECH_RK)  -  The  failure  to  develop  or  procure  any  element, 
component,  end-item,  or  subsystem 

•  Cost  (COST_RK)  -  Any  variation  in  predicted  costs  that  exceeds  an 
acceptable  level 

•  Schedule  Risk  (SCHED  RK)  -  Failure  to  meet  any  program  milestone  and/or 
complete  any  major  event  within  an  acceptable  time 
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5.5  LEVEL  IV:  ALLOCATION  OF  RESOURCES  AMONG  ALTERNATIVES 


The  next  level  will  assist  decision-makers  with  allocating  the  proportion  of 
available  resources  to  following  three  types  of  telemedicine  projects,  or  alternatives: 

•  Video  Teleconferencing  (VTC)  -  Video  Teleconferencing  applications 
are  real-time  applications  that  do  not  involve  direct  patient  care. 
Applications  include  continuing  education  and  administrative 
meetings. 

•  Real-Time  Telemedicine  -  Real-Time  telemedicine  applications 
involve  interactive  audio-visual  consultations  between  medical 
providers  and  patients  using  high-resolution  monitors,  cameras,  and 
electronic  medical  instrumentation,  etc.  and  involves  patient  care. 

•  Store-and-Forward  Telemedicine  -  Store-and-Forward  Telemedicine 
applications  involve  the  exchange  of  data  and  image  information  on  a 
delayed  basis. 

Figure  4  shows  the  EC  Model  configuration.  Note:  All  models  start  with 
equal  weights  for  all  objectives,  (sub)  objectives,  and  alternatives.  The  final 
weights  are  obtained  and  verified  during  the  data  collection  process. 


LEVEL  I:  GOAL 


LEVEL  II:  OBJECTIVES 


LEVEL  III: 
(SUB)  OBJECTIVES 


LEVEL  IV: 
(SUB)  O  BJECTIVES 


LEVEL  V: 
ALTERNATIVES 


Figure  4  Telemedicine  E&C  Model 
(which  shows  the  basic  EC  model  hierarchy) 


5.6  PRELIMINARY  EC  (PRIOR  TO  DATA  COLLECTION)  MODELS 


5.6.1  Figure  5  shows  Level  I  and  II  of  the  preliminary  EC  Benefits  model 
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Figure  5  Preliminary  EC  Benefit  Model  Level  I  &  II 
(which  shows  Level  I-Goal  and  11-Objectives  of  the  EC  Benefit  Model) 

5.6.2  Figure  6  shows  Level  II  and  III  of  the  preliminary  EC  Benefits  model 
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Figure  6  Preliminary  EC  Benefit  Model  Level  II  and  III 
(which  shows  Level  11-Objectives  and  IIL(sub)  Objectives  of  the 
EC  Benefit  Model) 
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5.6.3  Figure  7  shows  Level  I  and  II  of  the  preliminary  EC  Cost  Model 
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Figure  7  Preliminary  EC  Cost  Model  Level  I  and  II 
(which  shows  Level  I-goal  and  11-Objectives  of  the  EC  Cost  Model) 

5.6.4  Figure  8  shows  Level  II  and  III  of  the  preliminary  EC  Cost  Model 
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Figure  8  Preliminary  EC  Cost  Model  at  Level  II  and  III 
(which  shows  Level  11-Objectives  and  Il-(sub)  Objectives  of  the  EC  Cost  Model) 
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5.6.5  Figure  9  shows  Level  I  and  II  of  the  preliminary  EC  Risk  Model 
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Figure  9  Preliminary  EC  Risk  Model  Level  I  and  II 
(which  shows  Level  I-Goal  and  II-Objectives  of  the  EC  Risk  Model) 


5.6.6  Figure  10  shows  Level  II  and  III  of  the  preliminary  EC  Risk  model 
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Figure  10  Preliminary  EC  Risk  Model  Level  II  and  III 
(which  shows  Level  II-Objectives  and  Ill-(sub)  Objectives  for  the  EC 

Risk  Model) 
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After  data  collection,  the  resulting  proportional  weights  can  be  used  in 
evaluations  such  as: 


Cost-Benefit  Analysis  where 
or 


Benefit 

Cost 


•  Cost-Benefit-Risk  analysis  where  /  = 
or 


Benefit 
Cost*  Risk 


•  Optimization  of  Benefits 


5.7  THE  RATINGS  MODEL 

The  previous  evaluation  and  choice  (EC)  model  is  a  method  used  to  determine  the 
initial  amounts  that  should  be  allocated  to  the  three  types  of  projects:  VTC,  Real-Time 
and  Store-and-Forward  telemedicine.  The  ratings  approach  is  useful  to  further  indicate 
how  to  allocate  resources  within  a  given  type  of  project  to  individual  initiative.  The 
objectives  are  the  same,  however,  we  need  to  define  intensities  that  describe  objectives  at 
the  lowest  level  of  the  hierarchies. 

The  preliminary  intensity  levels  have  been  defined  for  all  objectives  at  the  lowest 
level.  These  levels  were  determined  by  pair-wise  comparison  of  intensity  in  terms  of  the 
next  higher  level  objective.  The  intensity  levels  may  either  qualitative  or  quantitative 
judgement  levels.  For  example,  the  technical  objective  of  “compatibility  with  existing 
information  systems”  may  be  defined  in  four  qualitative  intensity  levels: 

VERBAL  MODE  PAIR-WISE  COMPARISON 

Highly  Compatible  is  equally  to  moderately  more  preferable  than 
More  Compatible 

-  Highly  Compatible  is  moderately  more  preferable  than  Barely 
Compatible 

-  Highly  Compatible  is  strongly  more  preferable  than  Not  Compatible 

-  Moderately  Compatible  is  equally  to  moderately  more  preferable  than 
Barely  Compatible 

-  Moderately  Compatible  is  moderately  more  preferable  than  Not 
Compatible 

-  Barely  Compatible  is  equally  to  moderately  more  preferable  than  Not 
Compatible 
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The  resulting  local  intensity  levels  are: 


Local 

INTENSITY  LEVEL  (Compatibility  Objective)  Weight 


Highly  Compatible  (H_Compat)  0.483 

Moderately  Compatible  (M_Compat)  0.272 

Barely  Compatible  (M_Compat)  0.157 

Not  Compatible  (N_Compat)  0.088 


An  interpretation  of  the  above  local  weight  values  is  that  “highly  compatible”  is 
the  most  preferable  followed  by  “moderately”  and  “barely  compatible”.  “Not 
compatible”  is  the  least  preferred.  In  addition,  “highly  compatible”  is  approximately  3.1 
times  more  preferable  than  “barely  compatible”  and  5.5  times  more  preferable  than  “not 
compatible”.  The  above  weights  are  the  local  weights,  which  reflect  the  intensities  with 
respect  to  the  lowest  level  objective,  “compatibility”. 

A  summary  of  the  preliminary  local  weights  for  the  objectives  used  in  the 
assessment  tool  are  described  in  detail  in  Appendix  E.  - 

The  “global”  weights  are  the  weight  of  the  factor  with  respect  to  the  goal  and  are 
derived  by  a  process  of  priority  setting.  The  task  of  priority  setting  requires  that  the 
objectives,  (sub)  objectives,  and  the  alternatives  themselves  be  gradually  layered  in  the 
hierarchy  so  that  the  elements  in  each  level  are  compared  among  themselves  in  relation  to 
the  elements  of  the  next  higher  level.  Now  the  priorities  are  set  for  the  elements  in  each 
level  several  times  -  once  with  respect  to  each  objective  in  the  next  higher  level.  These 
in  turn  are  prioritized  with  respect  to  the  elements  in  the  next  higher  level  and  so  on. 

This  is  done  by  coming  down  the  hierarchy  and  weighting  the  priorities  measured  in  a 
level  with  respect  to  a  criterion  in  the  higher  level  by  multiplying  by  the  weight  of  that 
criterion.  The  weighted  priorities  can  then  be  added  for  each  element  in  the  level  to 
obtain  its  overall  or  global  priority38.  The  global  priorities  for  the  assessment  tool  will  be 
synthesized  after  the  collection  of  relevant  data. 


38  Saaty,  Thomas  L. ,  Fundamentals  of  Decision  Making  and  Priority  Theory  with  The  Analytic  Hierarchy  Process, 

pp.  11. 
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6. 


DATA  COLLECTION 


6.1  TECHNOLOGY  PROFILE  -  DATA  COLLECTION  INSTRUMENT 

The  purpose  of  the  Technology  Profile  is  to  gather  relevant,  in-depth  information 
about  the  individual  telemedicine  initiatives  and  serves  as  a  starting  point  for  discussions 
of  1)  what  technologies  are  currently  implemented,  2)  what  selection  decisions 
(judgements)  were  made  prior  implementation  of  these  initiatives,  and  3)  what  future 
initiatives  were  being  investigated  .  Figure  1 1  shows  the  4-step  development  process  for 
the  Technology  Profile.  The  Technology  Profile  involved  the  identification  of  relevant 
technologies,  conducting  pre-briefing,  interviews,  site  visits,  and  following-up  work  as 
necessary. 


Figure  1 1  4-Steps  in  the  Development  of  the  Technology  Profile 
(which  shows  the  requirements  for  on-site  data  collection) 

REL  presented  the  first  draft  of  the  Technology  Profile  during  the  4  DEC  98  In- 
Progress  Report  (IPR).  See  Appendix  F  for  reference.  A  second  version  of  the 
Technology  Profile  was  developed  and  piloted  in  TRICARE  Region  6  after  the 
incorporating  input  from  AMEDD.  See  Appendix  G  for  a  copy  of  the  2nd  draft  of  the 
Technology  Profile. 


6.2  BACKGROUND  INFORMATION 

With  the  help  of  GPRMC,  three  telemedicine  sites  were  identified  for  assessment: 
Brooke  Army  Medical  Center  (BAMC)  at  Fort  Sam  Houston,  Texas;  Darnall  Army 
Community  Hospital  (DACH)  at  Fort  Hood,  Texas;  and  Bayne-Jones  Amy  Community 
Hospital  (BJACH)  at  Fort  Polk,  Louisiana.  Over  the  course  of  three  months,  all  three 
sites  were  visited  and  interviews  were  conducted  with  members  of  the  clinical,  technical 
and  management  teams.  A  chronology  of  site  visits  and  points  of  contact  for  the  project 
are  shown  in  Appendix  H. 
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CHALLENGES  TO  MODEL  DEVELOPMENT 


After  review  of  preliminary  data,  REL  determined  that  a  majority  of  the  projects 
used  BAMC  as  the  telemedicine  infrastructure  hub,  consistent  with  BG  Claypool’s 
‘Hospital  Without  Walls’  concept  for  telemedicine.  BAMC  served  as  the  telemedicine 
hub  while  DACH  and  BJACH  served  as  the  spokes  for  the  majority  of  the  telemedicine 
efforts.  However,  some  projects  such  as  the  DACH  telepathology  project  typically  uses 
the  Armed  Forces  Institute  of  Pathology  (AFIP)  as  the  hub,  not  BAMC. 

One  difficulty  REL  encountered  in  gathering  data  for  the  Technology  Profile  was 
the  fact  that  the  telemedicine  equipment  (NEC)  had  not  been  used  in  normal  operations 
for  a  long  period  of  time.  According  to  some  users,  the  equipment  may  not  have  been 
operational  for  as  long  as  over  a  year.  Therefore,  it  was  difficult  to  assess  the  usefulness 
of  the  system.  Several  attempts  have  been  made  by  contracted  vendors,  working  along 
side  government  and  military  personnel  to  solve  the  numerous  technical  problems.  At  the 
time  of  this  report,  the  telemedicine  systems  were  not  operational  and  may  be  placed 
back  into  normal  operations  at  an  unspecified  date  sometime  later  this  year. 

In  addition,  REL  found  it  extremely  difficult  to  assess  the  effectiveness  of  the 
telemedicine  initiative  due  to  the  lack  of  data  associated  with  the  3 1  initiatives  examined. 
Quantitative  data  as  well  as  qualitative  data  was  not  available.  Since  data  collection  is 
not  a  part  of  the  regular  business  process  at  the  user  level,  relevant  data  is  only  available 
when  extra  effort  was  made  in  its  collection.  None  of  the  sites  had  a  regular  method  of 
data  collection  for  telemedicine  and  no  standard  identifying  required,  uniform  data  sets 
have  been  specified  nor  the  resource  requirements  for  data  collection  quantified  or 
appropriated.  Until  the  commission  of  the  Virginia  Tech  study  by  the  AMEDD  Board 
through  Vector  Research39,  which  is  still  on-going,  telemedicine  sessions  were  not 
regularly  recorded  as  such  on  any  form.  In  fact,  DACH  was  the  only  location  where 
telemedicine  and  VTC  usage  data  was  collected  and  supplied  for  this  study.  The  period 
of  collection  was  from  July  to  September  1997  for  telemedicine  and  July  to  December 
1997  for  VTC.  The  lack  of  data  problem  was  encountered  at  all  three  TRICARE  Region 
6  sites  and  affected  greatly  REL’s  ability  to  analyze  the  AMEDD  initiatives. 


39  Special  thanks  to  Professor  Sigrid  Gustafson  of  Virginia  Tech 
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6.2.1  BACKGROUND  INFORMATION  -  DOD  HEALTH  SERVICES 
REGION  6  (TRICARE  SOUTHWEST) 


T  RIC  AR  E 

S  o  u  t  h  west 


One  of  the  major  initiatives  in  the  TRICARE  Southwest  Region  is  the 
TRICARE  Southwest  National  Telemedicine  Network.  The  use  of  the  term 
‘telemedicine’  was  broadened  to  include  care  provided  through 
telecommunications  technology  in  the  form  of  systems  such  as  teleconsulting, 
teleradiology,  and  telepathology.  This  network  is  a  video  teleconferencing  based 
system40.  See  Appendix  H  for  the  TRICARE  Southwest  Brochure. 

TRICARE  Southwest  received  $4,500,000  from  Department  of  Defense 
(DOD)  to  finance  work  in  telemedicine.  The  TRICARE  Southwest  telemedicine 
projects  involved  34  facilities  and  clinical  services  such  as:  nursing,  general 
medicine,  primary  care,  and  general  surgery.  Twenty-four  specialty  services  were 
also  provided.  See  Appendix  I  for  additional  information  such  as  the  abstract 
summary  and  comprehensive  summary  of  the  primary/participating  organization, 
networks,  projects,  and  facilities  data.  The  data  summary  also  included 
information  for  BAMC,  DACH,  and  BJACH. 

Some  specific  applications  of  the  TRICARE  Southwest  National 
Telemedicine  Network  included  1)  a  remotely  controlled  examination  camera 
which  had  a  powerful  zoom-focus  capability  which  allows  a  dermatologist  to 
examine  small  details  of  a  patient's  skin;  2)  an  electronic  stethoscope,  in 
conjunction  with  real-time  digital  transmission  of  an  EKG  and  echocardiogram, 
permitted  a  cardiologist  to  do  a  complete  cardiology  examination;  3)  specific 
camera  adapters  and  resolution  capabilities  enhanced  by  remote-controlled  optics 
provided  an  ophthalmologist  a  clear  view  of  the  retina  of  a  patient  at  the  referring 
site;  4)  a  pathologist  using  the  telemicroscopic  adapter  examined  a  frozen  section 
or  bone  marrow  slide,  and  5)  a  document  camera  provided  with  the  teleradiology 
system  allowed  consulting  physicians  to  review  x-ray  films. 

The  TRICARE  Southwest  National  Telemedicine  Network  was  approved 
by  the  DOD  Military  Health  Services  System  (MHSS)  Proponent  Committee. 

The  four  stated  benefits  of  this  telemedicine  project  were41: 


40  http://www.tricaresw.whinc.af.mil/brochure.html,  TRICARE  Southwest  Brochure,  pp.  1 

41  TRICARE  Southwest  Brochure,  pp.  2 
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•  Increased  Access 

-  Telemedicine  will  improve  beneficiary  access  to  referrals 

•  Increased  beneficiary  and  provider  satisfaction 

-  Both  beneficiary  and  provider  satisfaction  will  increase  due  to  less 
traveling  for  the  patient  to  a  specialist  or  the  specialist  to  a  remote  site. 

-  The  family  practice  physician  will  maintain  control  of  the  patient  and 
thus  gain  knowledge  of  more  complex  medical  problems  and  improve 
continuity  of  care. 

•  Preparation  for  deployment 

The  providers  will  prepare  for  support  of  deployed  forces  via 
teleconsulting 

•  The  program  will  be  cost-effective. 

•  The  telemedicine  program  will  integrate  the  regional  referral  process  and 

facilitate  cross-service  referrals. 

It  was  estimated  that  the  system  could  avoid  over  $1  million  in  cost 
annually  from  reduction  in  travel  and  CHAMPUS  costs  throughout  the  remote 
locations  in  Region  6,  a  real  potential  exist  for  a  payback  within  three  years42. 

Another  Region  6  Lead  Agent  telemedicine  effort  is  the  "TRICARE 
Southwest  Managed  Care  University."  This  video  teleconferencing  network 
(VTCN),  or  "virtual"  university,  provides  continuing  executive  skills  education 
for  MTFs  in  the  region  via  VTCN.  The  course  material  relies  heavily  on  those 
already  available  or  under  development  from  existing  Air  Force,  Navy,  Army  and 
Uniformed  Services  University  of  the  Health  Sciences  sources.  Additional  course 
material  is  provided  by  sources  in  industry  and  academia,  such  as  the  U.S.  Army- 
Baylor  Graduate  Program  in  Health  Care  Administration,  Ft.  Sam  Houston,  San 
Antonio,  Texas;  and  the  School  of  Health  Care  Sciences,  Sheppard  AFB,  Wichita 
Falls,  Texas. 


42  TRICARE  Southwest  Brochure,  pp.  2-3 
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6.2.2  BACKGROUND  INFORMATION  -  GREAT  PLAINS  REGIONAL 
MEDICAL  COMMAND  (GPRMC  TELEMEDICINE) 


The  seven  Regional  Medical  Commands  (RMCs)  were  a  key  part  of  the 
AMEDD  restructuring  to  allocate  resources  and  oversee  the  day-to-day  operations 
in  the  medical  treatment  facilities  (MTFs)  while  the  U.  S.  Army  Medical 
Command  (MEDCOM)  headquarters  provided  strategic  vision  and  guidance.  The 
Great  Plains  Regional  Medical  Command  (GPRMC)  is  a  U.  S.  Army  Command 
that  included  10  U.  S.  Army  facilities  located  within  6  states.  TRICARE  Region 
6  is  situated  within  the  geographical  boundaries  of  GPRMC.  Figure  12  shows  the 
overlap  of  these  organizations.  All  three  Region  6  sites  examined  by  REL, 
BAMC,  DACH,  and  BJACH  were  located  within  the  GPRMC  boundaries. 

BG  Harold  L.  Timboe  currently  commands  GPRMC  as  well  as  Brooke 
Army  Medical  Center  (BAMC). 

I 


Figure  12  TRICARE  SOUTHWEST  (Region  6),  GPRMC,  and  BAMC,  DACH,  BJACH 

(which  shows  the  overlap  of  the  sites,  RMCs  and  TRICCARE  Regions) 
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6.2.2. 1  Telemedicine  System  Funding 

The  initial  purchase  for  telemedicine  system  at  BAMC/GPRMC 
dates  back  to  28  June  1995.  No  tracking  system  is  in  place  to  account  for 
the  telemedicine  and  Video  Teleconference  (VTC)  equipment  costs, 
installation,  upgrades,  and  maintenance.  An  extensive  internal  review  of 
telemedicine/VTC  equipment  and  equipment  costs  was  conducted  by  a 
BAMC  Auditor  for  Internal  Review  &  Audit  Compliance  Office  as 
indicated  by  a  draft  report  dated  15  January  1998.  It  was  determined  that 
approximately  $6M  may  have  been  expended  towards  telemedicine  and 
VTC  systems  during  the  period  between  December  1995  and  December 
1997.  However,  the  $6M  figure  may  only  be  a  gross  estimate  due  to  the 
following  factors: 

•  The  estimate  included  only  BAMC  and  HQ,  GPRMC 
transactions  because  they  were  both  under  BAMC  property 
accountability. 

•  Some  of  the  transactions  showed  that  HQ,  GPRMC  purchased 
telemedicine  and  VTC  communications  equipment  for  other 
MTFs  in  the  region. 

•  Some  systems  located  at  the  BAMC  warehouse  since  1 995 
have  been  opened  and  components  were  missing. 

•  Some  equipment  was  missing  during  an  inventory  and  others 
are  listed  improperly. 

•  The  telecommunication  costs  (such  as  leased  lines)  were  not 
included. 

•  Some  telemedicine  systems  shipped  to  BJACH  remain 
unopened  and  have  not  been  inventoried. 

•  The  telemedicine  and  VTC  cost  at  DACH  and  BJACH  were 
not  available. 

A  draft  copy  of  the  memorandum  for  the  Chairman  of  the 
telemedicine/VTC  Working  group  along  with  the  supporting  cost 
documentation  are  included  in  Appendix  K.  This  was  a  working  draft 
collected  at  REL’s  site  visit  on  9  February  1998.  REL  has  requested  the 
final  memorandum  but  has  not  received  it  to  date.  Therefore,  only  the 
draft  copy  is  included  in  this  report. 
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One  of  the  goals  of  the  Technology  Profile  was  to  gather  not  only 
technical  but  also  financial  cost  data  including  the  initial  purchase, 
maintenance,  and  subsequent  upgrades  in  order  to  assess  the  entire 
telemedicine  project  assessment.  Unfortunately,  financial  data  along  with 
usage  data  was  not  available  and  was  difficult  to  obtain.  Therefore,  REL 
was  unable  to  get  a  better  cost  estimate  than  the  rough  order  of  magnitude 
(ROM)  of  $6M  associated  with  initiatives  within  GPRMC.  It  would  be 
very  difficult  to  distribute  the  project  cost  associated  with  each  initiative 
due  to  a  lack  of  precise  and  complete  accounting  records. 
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6.3  BROOKE  ARMY  MEDICAL  CENTER  TELEMDICINE 

Brooke  Army  Medical  Center  (BAMC)  is  a  modern  state-of-the-art  health 
care  facility  located  at  Fort  Sam  Houston,  Texas  with  the  capability  of  providing 
Level  I  trauma  support  and  graduate  education.  BAMC’s  $253  million  project 
replaced  most  of  BAMC’s  old  1938  facilities  and  now  provides  care  in  a  new 
450-bed,  1.5-million-square-foot  facility.  Along  with  Wilford  Hall  Medical 
Center,  the  regional  TRICARE  lead  agent,  BAMC  and  WHMC  serves 
approximately  185,000  beneficiaries.  On  14  March  1996,  BAMC  was  officially 
dedicated  and  on  13  April  1996,  BAMC  was  open  for  business43. 

BAMC’s  telemedicine  projects  were  almost  synonymous  with  those  of 
GPRMC  and  TRICARE  Region  6  telemedicine  projects.  The  reason  was  that 
BAMC  also  served  as  the  headquarters  for  GPRMC  and  utilized  funds  from  both 
GPRMC  and  TRICARE  Region  6. 

The  GPRMC  Telemedicine /VTC  Working  group  began  in  July  1997  and 
met  on  a  monthly  basis.  It  is  a  forum  to  share  information,  address  and  coordinate 
among  the  various  system  stakeholders.  The  working  group  has  convened  at  least 
seven  meetings  to  date.  Some  issues  the  group  addressed  during  past  meetings 
included:  reporting  procedures  to  the  DOD  Medical  Network  Service  Center  for 
network  problems;  identification  of  help,  scheduling,  and  training  functions  at 
BAMC;  comprehensive  equipment  inventory  and  cost;  addressing  departmental 
telemedicine  and  VTC  needs.  Notes  from  the  second  to  the  seventh  meeting  are 
shown  in  Appendix  L. 


43  Brooke  Army  Medical  Center  works  in  New  State-of-art  Facility,  The  Mercury,  Public  Affairs  Office,  HQ 
MEDCOM,  Fort  Sam  Houston  Texas.  Fall  1996,  pp.  14 
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Since  data  collection  is  not  a  regular  output  of  the  Telemeclicine/VT C 
business  process,  it  was  difficult  to  estimate  the  usage  levels  of  the  various 
systems.  Telemedicine  and  VTC  data  were  not  actively  collected  by  BAMC 
persomiel  on  a  regular  basis.  Therefore,  the  lack  of  utilization  data  is  apparent  in 
the  BAMC  Technology  Profile  shown  in  Appendix  M. 

Although  utilization  data  was  not  available  from  BAMC,  other  data  such 
as  configuration  and  connectivity  data  were  collected.  From  these  alternate 
sources,  the  following  telemedicine  and  VTC  activities  were  inferred  and 
summarized  in  Table  2.  Data  such  as  the  frequency  of  use,  duration  of  session, 
final  outcome  data  were  not  available. 


Dent 

Description 

App. 

Department 

Medicine 

Grand  Rounds/CME  to  MEDDACS 

VTC 

Department  of  Medicine 

RRC  requirements/distance  learning 

VTC 

DOM  Residents  at  DACH<- 
>BAMC 

Continuity  Clinic 

T-Med 

DOM  Residents  at  DACH<- 
>BAMC 

Gastroenteroscopy 

T-Med 

GI  Svc 

Echocardiography 

T-Med 

Cardiology  Svc 

Clinical  Invest. 

Research  Ethics  Course 

VTC 

DCI 

Institutional  Review  Board  Mtgs 

VTC 

DCI 

Preventive 

Med. 

Preventive  Medicine  Conferences 

VTC 

Preventive  Medicine 

Radiology 

BAMC  <->DACH  radiology 

T-Med 

Department  of  Radiology 

Resident  teaching  WHMC<->BAMC 

VTC 

Department  of  Radiology 

Teleradiology  throughout  GPRMC 

T-Med 

Department  of  Radiology 

Dermatology 

Teledermatology  DACH  <->  BAMC  (Research) 

T-Med 

Department  of  Dermatology 

Pediatrics 

subspecialty  peds  Clinics 

T-Med 

DACH  to  8c  WH  peds  sub  clinic 

NICU  level  2  to  NICU  level  3 

T-Med 

DACH  NICU  to  San  Antonio 
NICU  WH 

Resident  continuity  clinics 

T-Med 

DACH  to  8c  WH  peds  sub  clinic 

Resident  teaching  conf 

VTC 

WH  to  DACH  to  BAMC  clinic 

Surgery 

(On  Loan)  Neurosurgery  Conference  Room 

VTC 

Neurosurgery  Conf.  Rm. 

Ft  Carson  <->  BAMC 

Urology 

Ft  Riley  <->  BAMC 

Urology 

Ophthalmologic  consultations 

E2&22I 

Ophthalmology 

Otolaryngologic  consultations 

T-Med 

ENT 

Pathology 

Telelpathology  DACH<->  BAMC  <->AFIP 

T-Med 

Anatomic  Pathology 

Psychology 

Consultaltions  BAMC  <->  Ft  Polk 

T-Med 

Psychology 

Dental 

Teledentistry  BAMC  <->  GPRMC 

T-Med 

Dental  Clinic 

Health  Promo. 

Health  promotion  education  BAMC<->GPRMC 

VTC 

HPC  Classroom 

T-Med  Suite 

VTC  /  Consults 

VTC 

Any 

TelMed  /  Consults 

T-Med 

Any 

Nursing  Ed. 

VTC  /  Distance  Learning 

VTC 

NESD  Classroom 

Table  2  BAMC  Telemedicine  /VTC  Activity 
(which  shows  the  types  of  Telemedicine/VTC  activities  at  BAMC) 
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Each  of  the  following  projects  was  identified  as  a  separate  initiative  for  analysis 
using  the  health  technology  assessment  tool.  Table  3  showed  the  various  telemedicine 
and  VTC  activities  between  BAMC  and  other  MTFs  in  GPRMC.  Again,  usage  level  data 
was  not  available  for  any  of  these  activities. 


ACTIVITY 

PRIME  POC 

FT  SILL,  OK 

Emergency  Dept.,  RACH 

MAJ  Kevin  Hammond,  MC 

FT  HOOD,  TX 

Dept,  of  Medicine/Neurology,  DACH 

MAJ  Erik  Kobylarz,  MC 

Pediatrics,  DACH 

COL  Marshall  Dressel,  MC 

OB/GYN,  DACH 

MAJ  Susan  Dunlow,  MC 

Dept,  of  Ambulatory  Care,  DACH 

MAJ  Ronald  King,  MC 

Otolaryngology,  DACH 

MAJ  Heidi  Close,  MC 

Dept,  of  Surgery,  DACH 

LTC  James  Leech,  MC 

Emergency  Dept.,  DACH 

MAJ  Albert  Villarin,  MC 

Dept  of  Medicine,  Tremmier  Clinic 

CPT  Howser,  MC 

Emergency  Dept.,  DACH 

LTC  Clyde  Turner 

Emergency  Dept.,  DACH 

1LT  Frey,  Admin  Officer 

IMO,  DACH 

Mr.  Ed  Pitt 

T-MED  project  officer,  DACH 

MAJ  Robert  Newhouse 

FT  CARSON,  CO 

Emergency  Dept.,  RACH 

MAJ  Michael  Bowen,  MC 

FT  POLK,  LA 

Emergency  Dept.,  BJACH 

CPT  Erwina  Ungos,  MC 

FT  RILEY,  KS 

Emergency  Dept., 

CPT  Jeff  Hartman,  MC 

Urology  Svc., 

CPT  Patricia  Crane,  MC 

T-MED  project  officer,  Irwin  ACH 

1LT  Joseph  Keizer 

Micheline  Fields,  IMO 

FT  LEAVENWORTH,  KS 

FT  LEONARD  WOOD,  MO 

POC  only 

Connie  Lubina 

MEDEL,  SOTO  CANO,  HONDURAS 

Medical  Group  Command 

COL  Gail  M.  Johnson,  MC 

Joint  Task  Force  Bravo 

CPT  Neri,  LOG  &  T-Med  Project  Officer 

Table  3  BAMC  Telemedicine/VTC  Activity  with  GPRMC  MTFs 
(which  shows  Telemedicine  POCs  for  GPRMC) 


Page  43 


-  .  -  f0Rr  mfliK  ffXAS 

■ „  .  '  •  •  -  ■*!  'v  ••• 


6.4  DARNALL  ARMY  COMMUNITY  HOSPITAL  TELEMDICINE 

Darnall  Army  Community  Hospital  (DACH)  with  264  beds  serves  Fort  Hood,  one 
of  the  world’s  largest  military  posts  and  home  to  III  Corps,  1st  Calvary  Division  and  4th 
Infantry  Division.  Darnall  Army  Community  Hospital  is  currently  commanded  by  COL 
Kenneth  L.  Farmer  Jr.,  MC.  Darnall’s  40-mile  catchment  area  includes  Gatesville  to  the 
North,  Temple  to  the  East,  Georgetown  to  the  South  and  Lampasas  to  the  West.  The 
demographics  of  the  catchment  area  includes  141,000  DOD  beneficiaries  with  30% 
Active  duty,  38%  ADFM,  28%  RET&FM,  and  4%  Medicare  patient  population44.  Five 
clinics  outside  of  DACH  are  operated  by  Darnall  and  are  considered  Primary  Care 
Managers  under  the  TRICARE  prime  option.  These  clinics  include: 


CLINIC 

LOCATION  1 

4th  ID  TMC  -  Bennett  Health  Clinic 

3 1st  Street  &  Battalion  Ave.,  Ft.  Hood 

Monroe  TMC 

3 1st  Street  &  Battalion  Ave.,  Ft.  Hood 

Adult  Chronic  Care  (AC3)  Clinic 

2900  S.  Trimmier  Road,  Killeen,  TX 

Family  Care  Clinic 

2201  South  W.S.  Young  Plaza,  Killeen,  TX 

Family  Care  Clinic 

819  East  Highway  190,  Copperas  Cove,  TX 

Table  4  Darnall  Operated  Clinics 
(which  shows  the  locations  of  the  DACH  Clinics) 


44  Farmer,  K.,  Command  Brief,  oral  presentation,  December  1997 


With  41,725  Active-Duty  soldiers  and  136,000  enrollment  eligible,  a  typical  day 
at  DACH  may  be  characterized  by: 


DESCRIPTION 

NUMBER 

CLNIC  VISITS 

2,223 

3  Family  Care  Clinics 

382 

DACH  Specialty  Clinics 

1,256 

Troop  Medical  Clinics 

456  *  Does  not  include  BAS  visits 

Emergency  Room  Visits 

129 

Admissions 

34 

Beds  Occupied 

88 

Live  Births 

8.3 

Surgical  cases  (Same-Day  &  Major) 

13 

Meals  Served 

1,070 

Prescriptions  Filled 

3,300 

Laboratory  Tests 

1,328 

Table  5  Typical  Day  at  DACH  (OCT  96  -  JUN  97) 
Average  daily  number  computed  using  a  7-day  week 
(which  shows  the  types  and  levels  of  medical  activity  at  DACH) 


The  top  6  DRGs  at  DACH  during  the  period  FY  97  (1  OCT  96  to  30  SEP  97) 
include:  Vaginal  deliver  without  complications  (1940  cases),  Normal  Newborn  (1858 
Cases),  Neonate  with  significant  problems  (675  cases).  Bronchitis  and  Asthma  (242 
Cases),  Vaginal  deliveries  with  complications  (233  cases),  and  Neonate  with  minor  to 
moderate  problems  (180  cases). 

Army  Graduate  Medical  Education(GME)  is  conducted  in  all  MEDCENs  and 
some  MEDDACs.  Current  Darnall  GME  training  programs  are  shown  in  Table  6.  In 
addition  to  Army  GMEs,  DACH  participated  in  a  partnership  for  Texas  which  includes 
Texas  A&M  university  Health  Science  Center  (College  of  Medicine),  Scott  &  White 
Memorial  Hospital  and  Clinic,  Driscoll  Children’s  Community  Hospital  and  Department 
of  Veterans  Affairs  Central  Texas  Health  Care  System. 
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DARNALL  GME 

Emergency  Medicine  Residency  Program 

COMBINED  GME  PROGRAMS 

-  OB/GYN 

BAMC/WHAFMC 

Pediatrics 

BAMC/WHAFMC 

Medicine 

BAMC 

AFFILIATED  GME  PROGRAMS 

Family  Practice 

UNTHSC 

FM  (Psychiatry,  Dermatology,  Pediatrics,  OB, 
Orthopedics) 

Scot  &  White  Memorial 
Hospital  and  Clinic 

Podiatry 

VA  Waci 

Surgery 

WHAFMC 

Pediatrics 

Keesler  AFB 

EM  (OB,  Dermatology,  Radiology) 

BAMC 

Medical  Students 

USUHS  &  Nationwide 

Health  Care  Administration 

Baylor 

Table  6  DACH  GME  Program 
(which  shows  the  GME  programs  at  DACH) 

The  clinical  staff  at  Darnall  has  expressed  the  need  for  both  the  dial-anywhere  and 
store-and-forward  telemedicine  capabilities.  The  following  sections  describe  the 
telemedicine  configuration  between  DACH  and  BAMC  prior  to  the  move  to  the  new 
BAMC  and  the  current  configuration.  A  brief  description  of  the  provided  service,  current 
issues,  and  future  plans  is  also  included. 

DACH  has  developed  both  a  Business  Plan  and  Standard  operating  Procedures  for 
Telemedicine.  These  documents  are  included  in  Appendix  N  and  O  for  reference.  The 
business  plan  shows  the  implementation  BG  Claypool’s  “Hospital  Without  Walls” 
concept.  DACH’s  intent  was  to  leverage  technology  in  order  to  reduce  the  already  taxed 
MEDDACs  with  the  growing  beneficiary  population  due  to  the  Army’  execution  of  the 
Base  Realignment  and  Closure  Act  (BRAC).  This  Business  Plan  can  be  expanded  to 
address  business  areas  such  as  the  market  analysis  and  competitive  analysis,  as  well  as 
financial  overview  such  as  financial  history,  financial  needs,  and  breakeven  analysis. 
These  elements  would  generally  be  covered  in  a  complete  private  sector  business  plan. 

Prior  to  the  move  to  the  new  BAMC,  Mr.  Ed  Pitt,  Chief,  Telecommunications 
collected  the  only  existing  telemedicine  usage  data.  DACH  usage  data  was  separated  into 
two  categories,  telemedicine  and  video  teleconference.  The  data  is  shown  in  Figures  13, 
14  and  15.  Unfortunately,  with  the  move  to  new  BAMC  combined  with  the  upgrade  to 
dial-anywhere  capability  and  the  associated  technical  difficulties,  telemedicine  usage  data 
after  25  SEP  96  and  Video  teleconference  data  after  31  DEC  96  are  not  available. 
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Although  many  departments  at  DACH  express  a  variety  of  telemedicine  usage’s, 
the  widespread  of  telemedicine  has  not  been  realized.  Some  sample  documentation  of 
these  requests  is  included  in  Appendix  P.  The  REL  Technology  Profile  for  DACH  is 
included  in  Appendix  Q. 

VIDEO  TELECONFERENCING 

JULY  1  THRU  25  SEP  1996 
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Figure  13  Video  Teleconference  Usage  for  4th  Quarter  FY  96 
(which  shows  a  declining  usage  level) 
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Figure  14  Video  Teleconference  Usage  for  1st  Quarter  FY  97 
(which  shows  an  increased  usage  in  November  97) 
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TELEMEDICINE 
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Figure  15  Telemedicine  Usage  for  4th  Quarter  FY  96 

(which  shows  a  declining  usage  level  especially  for  September  1996) 


CONFIGURATION  PRIOR  TO  MOVE  TO  NEW  HOSPITAL 

Prior  to  BAMC’s  move  to  the  new  hospital,  five  direct  point-to-point  T1  lines 
were  shared  between  any  of  the  5 1  designated  locations  within  DACH  and  BAMC.  Two 
of  the  lines  remained  at  full  T1  rate  for  the  Psychiatry  ad  Dermatology  clinics.  The 
boxes,  with  the  number  situated  on  the  right  of  the  service  end,  indicate  the  NEC  carts 
and  the  predominant  location  for  that  cart. 


(Prior  to  BAMC  move  to  new  hospital) 
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Figure  16  DACH/OLD  BAMC  Configuration 

(which  shows  there  were  29  drops  at  Old  BAMC  and  5 1  drops  at  DACH) 
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The  projected  configuration  after  the  move  to  the  new  BAMC  was  to  extend  the 
TELEOS/IDNX  network  for  total  flexibility  in  the  telemedicine/VTC  area.  The  current 
DACH  configuration  as  of  22  JAN  98  is  shown  in  Figure  17.  This  configuration  depends 
on  a  fully  operational  TELEOS  /IDNS  network.  Unfortunately,  due  to  technical 
problems,  current  system  is  not  yet  operational.  The  DACH  vision  is  shown  in  Figure  18. 

In  addition.  Table  7  shows  the  location  and  connectivity  of  the  DACH 
telemedicine/VTC  Equipment  at  the  computer  room  level. 
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DACH  CONFIGURATION 
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Figure  17  DACH  Configuration  as  of  January  1998 

(which  shows  connectivity  through  the  TELEOS) 
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BAMC  -  DACH  VISION 
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Figure  18  BAMC/DACH  Vision 

(which  shows  connectivity  with  MEDNET,  TTVN  and  BELNET) 
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Table  7  DACH  Equipment  Locations  and  Connections 

(which  shows  the  connectivity  at  the  DACH  computer  room  level) 
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TELERADIOLOGY 


DACH  installed  a  filmless  imaging  system  utilizing  the  Fugi  Image  System.  This 
project  brought  Computed  Radiology  (CR)  units  to  the  4th  ID  Bennett  Clinic  and  Monroe 
TMC.  The  transmission  of  images  to  the  MRI  section  of  DCH  is  via  Optical  Fiber.  The 
purpose  of  this  system  was  to  eliminate  the  need  for  transporting  hard  copy  images  from 
the  TMCs  to  the  hospital. 


TELERADIOLOGY 


Figure  19  DACH  Teleradiology  Configuration 
(which  shows  DACH  connectivity  with  BAMC,  4,h  ID  MC  and  Monroe  TMC) 


TELEPATHOLOGY 

The  existing  system  at  DACH  consisting  of  sending  pathology  lab  images  to  the 
Armed  Forces  Institute  of  Pathology  over  a  twin  56Kbs  line  using  a  Roshe  Imaging 
System.  During  the  follow-up  site  visit,  a  DACH  Pathologist  demonstrated  the  ease  of 
use  of  the  system  without  any  assistance  from  others.  It  appears  that  the  use  of  the 
telepathology  technology  has  been  integrated  into  the  regular  business  practice  of  the 
pathology  department. 

TELEPATHOLOGY 


NOW  VISION 


Figure  20  DACH  Telepathology  Configuration 
(which  shows  DACH  connectivity  with  AFIP  now  and  AFIP/BAMC  in  the  future) 


AC-3  CONNECTIVITY 


The  recently  established  Adult  Chronic  Care  Clinic  (AC3)  located  in  the  City  of 
Killeen  utilizes  T1  data  lines  between  the  AC3  and  DACH  to  provide  telemedicine 
capabilities,  transmit  CHCS  data,  and  utilizes  the  IFICS  system  I  daily  operations. 

The  configuration  today  between  DACH  and  AC3  is  a  combination  of  leased  T1 
line  and  2  leased  56KBs  lines,  and  a  sprint  CENTEL  telephone  system.  Figure  21  shows 
the  current  and  future  configuration.  The  future  vision  for  AC3  is  dependent  on  the 
TELEOS/IDNS  system  becoming  fully  operational. 


AC-3  CONNECTIVITY  AC3  DACH  CONNECTIVITY 


Figure  21  Current  and  Future  AC3  Configuration 
(which  shows  connectivity  today  and  through  the  TELEOS  in  the  future) 


PICTEL  VIDEO  TELECONFERENCING 

Two  PicTel  VTC  system,  including  a  new  system  installed  for  use  by  the  Region 
VI  lead  agent,  is  utilized  at  DACH.  Either  of  the  PicTel  Systems  has  the  capability  to 
dial-up  other  PicTel  locations  or  systems  that  have  access  to  the  TTVN.  The  system 
utilizes  twin  56KBs  phone  lines  for  passing  data/information.  See  Figure  22  for  the 
current  configuration. 
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DACH 


PICTEL  VIDEO  TELECONFERENCING 
(NOW) 


Figure  22  DACH  VTC  (PicTel)  Configuration 
(which  shows  connectivity  to  TTVN  and  the  Lead  Agent) 


DACH  AWE  SUPPORT 

DACH  provided  Level  V  teleconsultation  support  for  the  97-92  Task  Force  XXI 
AWE.  The  AWE  was  conducted  during  10-30  March,  1997  at  Fort  Irwin,  California  in 
support  of  the  Experimental  Force  (EXFOR)  of  the  4th  Infantry  Division  (Mechanized). 
DACH  Emergency  Department  (ED)  provided  24  hour  telemedicine  consultative  support 
for  the  exercise.  The  equipment  used  at  both  the  National  Training  Center  (NTC)  and 
DACH  is  shown  in  Table  8. 


NTC  EQUIPMENT 

DACH  EQUIPMENT 

-  Fairchild  Satellite  Router 

-  PictureTel  28  inch  monitor/control  panel 

-  CLI  Computer  Processor 

-  VCR  for  recording/  no  digitization  available 

-  Satellite  Transmitter 

-  Omnipositional  microphone  &  Camera 

-  Sony  TV  with  TV  Camera 

-  56Kbs  modem 

-  Digital  Camera 

-  landlines  -  DACH  56KBs  wiring 

-  McIntosh  Laptop 

-  VTC  Room  191 1  -  DACH  Emergency  Dept. 

-  Adobe  Photoshop  &  Delrina  Form  Flow 

Table  8  NTC  and  DACH  Configuration  for  97-02  Task  Force  XXI  AWE 
(which  shows  a  slow  but  operational  system  for  the  AWE) 

The  patient  profile  for  the  NTC  included  both  real-life  injuries  and  play 
casualties.  The  real-life  injury  data  is  shown  in  Table  9  below.  All  30  real-life  injuries 
were  evacuated.  The  warfighter  exercises  every  other  day  included  90  to  150  play 
casualties  including  trauma,  medical,  psychiatric,  chemical  and  biological  casualties. 
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Ortho 

10 

Derm 

1 

OB/GYN 

5 

Opth 

1 

Psych 

3 

Neuro 

1 

IM 

2 

Dental 

1 

Pulm 

2 

Gen  Surg 

2 

Table  9  Real  Life  Injuries  during  AWE  97-02 
(which  shows  the  actual  patient  load  during  the  AWE) 

LESSONS  LEARNED 

The  major  constraints  to  effective  application  of  telemedicine  in  service  delivery 
appear  to  have  been  due  to  weather  and  equipment  according  to  staff.  The  windstorms 
during  the  exercise  caused  signal  fluctuations.  The  modem  speed  at  56  KBs  was  too 
slow.  DACH  needed  faster  lines  either  via  T1  or  TELEOS.  In  addition,  there  were  no 
digitization  capabilities  especially  for  x-ray.  The  equipment  was  operational  but  outdated 
including  the  satellite  transmitter,  the  CLI  unit,  and  the  modem.  The  equipment  was 
large  and  cumbersome.  However,  the  exercise  showed  that  the  ED  staff  two-hour 
training  session  prior  to  deployment  improved  the  experience,  the  ED  was  receptive  to 
consults  depending  on  the  time  of  day  and  the  connectivity  improved  moral  of  field 
physicians. 

DACH/  TEXAS  A&M  INITATIVE 


The  Texas  A&M  initiative  connects  DACH  to  Texas  A&M  via  T1  data  lines 
utilizing  a  V-TEL  video  conferencing  system.  Through  this  connectivity,  DACH  was 
able  to  conduct  video  conferencing  with  a  growing  number  of  health  and  educational 
facilities  supporting  the  Trans  Texas  Videoconferencing  Network  (TTV).  The  Ft.  Hood 
III  Corps  Educational  Center  has  utilized  a  portion  of  the  T1  to  Texas  A&M  to  support 
soldiers  assigned  to  the  post  participating  in  educational  programs  provided  by  major 
educational  institutions  in  Texas. 


TEXAS  A&M  CONNECTIVITY 


Figure  23  Texas  A&M/DACH  Configuration 
(which  shows  connectivity  with  Ft.  Hood  Education  Center  to  TTVN) 
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6.5  BAYNE-JONES  ARMY  COMMUNITY  HOSPITAL  TELEMEDICINE 

The  Medical  Department  Activity  at  Fort  Polk  includes  Bayne- Jones  Community 
Hospital  (BJACH),  a  Preventive  Medicine  Service  and  Department  of  Psychiatry. 
BJACH  is  a  169-bed  mid-sized  medical  facility.  The  area  of  responsibility  of  the  Fort 
Polk  MEDDAC  includes  the  entire  state  of  Louisiana45. 

BJACH  provides  service  to  approximately  32,000  individuals:  12,000  soldiers, 
3,000  retirees,  1 1,000  family  members,  and  6,000  others46.  The  12,000  soldiers  include 
the  impact  of  60,000  rotational  troops  per  year.  Since  March  1993,  Fort  Polk  became  the 
official  home  of  the  Joint  Readiness  Training  Center  (JRTC).  The  JRTC  is  the  U.S. 
Army’s  premier  training  center  for  light  infantry  and  special  operations  units.  The 
clinical  staff  at  BJACH  includes  46  military  physicians,  28  military  and  28  civilian 
nursing  staff,  369  civilians,  35  FTE  contractors,  14  Full  Time  Equivalent  (FTE)  Red 
Cross  volunteers  and  6  deployed  active  duty  military  personnel. 

Although  NEC  telemedicine  equipment  was  shipped  to  BJACH  from  GPRMC, 
the  REL  team  was  informed  that  the  equipment  are  still  in  their  shipping  crates  and  have 
never  been  in  use.  However,  another  department  (not  IMO)  utilized  VTC  equipment  and 
utilization  information  has  been  requested  through  channels.  At  the  time  of  this  report, 
no  VTC  information  has  been  received. 


45  http://www.polk.amedd.ariny.mil/about.html 

46  Fox,  W.,  The  Joint  Commission  of  the  Accreditation  of  Healthcare  Organizations,  Oral  Presentation,  March  1998 
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At  the  time  of  this  report,  no  telemedicine  activities  were  reported  at  BJACH  but 
there  were  discussions  by  the  Commander,  COL  C.  William  Fox  that  teleradiology  and 
telepathology  services  were  being  considered  for  future  implementation.  Therefore,  the 
BJACH  Technology  Profile  (Appendix  R)  shows  a  low  level  of  telemedicine  activity. 


6.6  MEDNET 

At  the  center  of  the  telemedicine  network  for  the  Region  6  is  a  DS3  network 
called  MEDNET.  A  current  map  of  this  network  is  shown  in  Appendix  S.  The  hub  of 
this  network,  the  NOD,  is  located  in  San  Antonio,  Texas.  The  MEDNET  began  as  a  small 
network  used  to  connect  the  various  telemedicine  projects  grew  to  over  50  sites  by 
January  1998  and  continues  to  grow  in  numbers  today. 

Since  recent  telemedicine  usage  data  was  not  available  at  any  of  the  three  sites, 
the  REL  team  conducted  a  visit  the  NOD  and  was  able  to  obtain  some  relevant  data.  The 
NOD  system  administrator  routinely  gathers  network  information  such  as  network  load 
capacity,  and  security  related  information.  A  billing  report  for  BAMC  for  February  25, 

1 998  is  shown  in  Appendix  T.  Another  routine  outputs  of  the  monitored  activity  at  NOD 
was  a  call  duration  report  which  shows  the  origination  and  termination  of  every  call  from 
a  node  (or  location),  the  connection  time,  and  the  duration  of  the  call.  A  sample  load 
report  for  Node  10  (BAMC)  for  the  period  of  February  16  to  23,  1998  is  shown  in 
Appendix  U. 

Although  the  call  report  does  not  reveal  information  concerning  the  content  and 
the  outcome  of  the  telemedicine  or  VTC  usage,  it  does  give  a  clue  into  the  usage  level  of 
various  areas/departments  that  was  not  available  at  any  of  the  various  sites.  With  the 
assistance  from  NOD  Personnel,  REL  was  able  to  extract  some  relevant  usage  level 
information.  For  example,  BAMC  is  designated  as  Node  10  and  Wilford  Hall  Medical 
Center  is  designated  as  Node  100  by  the  MEDNET  NOD.  Card  58  (C58)  and  ports  24  to 
46(P24-46)  are  reserved  for  MDIS  transmissions.  Twenty-three  consecutive  calls  with  . 
duration  about  5  minutes  are  required  for  one  standard  MDIS  image.  Medical  Diagnostic 
Imaging  Systems  (MDIS)  is  a  teleradiology  system  installed  at  both  BAMC  and  WHMC. 

With  such  information,  the  attached  call  duration  report  may  be  summarized  into 
the  following  information  concerning  telemedicine  and  VTC  usage  by  BAMC  via  the 
MEDNET  for  the  period  of  February  16  to  23,  1998.  A  complete  summary  is  also  shown 
in  Appendix  U. 

•  Total  of  1 05  calls  were  initiated  for  a  total  of  1 ,049, 1 1 2.96  minutes 

•  Call  destinations  included:  WHMC  (N 1 00),  Intra  BAMC  (N 1 0),  NOD  (N8), 
DACH  (N1 1),  POLK  (N12),  SILL  (N14),  MEDCOM  (N19),  MAMC  (N20), 
BLISS  (N51),  EAMC  (N60),  TAMC  (N70),  CARSON  (N80),  REILEY 
(N82),  and  LEVENWORTH  (N83) 

•  43  MDIS  calls  were  initiated  for  a  total  of  1 82.99  minutes 
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6.7  DATA  COLLECTION  SUMMARY 


It  is  obvious  from  the  information  presented  in  the  previous  sections  6.2  to  6.6, 
that  more  data  is  necessary  to  properly  evaluate  the  present  AMEDD  and  AMEDD-led 
telemedicine  initiatives  using  the  health  technology  assessment  tool.  Therefore,  the 
following  tasks  in  the  Statement  of  Work  cannot  be  completed  without  further  guidance: 

•  Analyze  current  AMEDD  and  AMEDD-led  telemedicine  initiatives  within  the 
DOD  Telemedicine  Testbed  Database  using  the  telemedicine  health 
technology  assessment  tool.  The  assessment  tool  will  incorporate  the 
following  criteria  into  the  development  methodology: 

•  Group  similar  AMEDD  and  AMEDD-led  telemedicine  initiatives  based  on 
obvious  relationships  (Each  of  the  data  elements  in  the  health  technology 
assessment  tool  such  as  VTC,  compatibility,  maintenance,  efficiency,  etc. 
may  serve  as  the  basis  to  group  the  data.  See  Appendix  V  for  one  such 
grouping  -VTC,  Real-Time,  Store-And-Forward  applications.) 

•  Sequence  AMEDD  and  AMEDD-led  telemedicine  initiatives  by  rank 
order  based  on  value  derived  by  applying  the  criteria  described  above 
(See  section  6.8  for  assessment  tool  capability  based  on  simulated  data) 

•  Analyze  initiatives  for  redundancy  and  identify  superior  AMEDD  and 
AMEDD-led  telemedicine  initiatives  based  on  criteria  described  above 
(more  data  is  necessary  to  properly  evaluate  for  redundancy  and  identify 
superior  initiatives) 

•  Identify  existing  gaps  between  current  AMEDD  and  AMEDD-led 
telemedicine  initiatives  and  recommend  new  initiatives  to  accomplish  the 
criteria  described  above.  (More  data  is  necessary  to  identify  gaps  between 
current  AMEDD  and  AMEDD-led  telemedicine  initiatives  and  to 
recommend  new  initiatives) 

•  Analyze  the  merit  of  each  AMEDD  and  AMEDD-led  telemedicine  initiatives 
against  the  criteria  described  above,  (more  data  is  necessary  to  analyze  the  merits 
of  the  initiatives) 

The  summary  of  required  data  elements  and  the  results  of  the  data  collection  in  terms 
of  level  of  completeness  is  shown  in  Appendix  W.  Although  the  collected  data  can  not  be 
analyzed,  the  following  section,  6.8  presents  simulated  data  in  order  to  validate  the 
health  technology  assessment  tool  and  its  effectiveness  in  analysis  of  telemedicine 
initiatives. 
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6.8  SAMPLE  APPLICATION  HEALTH  TECHNOLOGY  ASSESSMENT 

TOOL  USING  SIMULATED  DATA 

Since  the  EC  models  involve  the  initial  allocation  of  resource,  the  analysis  may 
include  1)  benefits  only,  2)  cost-benefits,  and  3)  cost-benefits-risk.  All  three  types  of 
analysis  will  be  addressed  in  this  section  of  the  report.  The  resulting  weights  relate  to  the 
proportional  allocation  of  resources  among  the  alternatives  and  do  not  include  the 
analysis  of  existing  initiatives.  However,  these  weights  are  critical  in  determining  the 
weights  of  the  objectives  that  will  be  used  in  the  rating  model  to  evaluate  the  initiatives. 
In  addition,  EC  Model  #3  is  explained  in  detail  including  all  assumptions  that  were  used 
to  synthesize  the  weights. 


# 

File  Name 

5  Objectives 

3  Sub(Objective) 

Criteria 

Alternatives 

mm 

T1A.EC1 

All  Equal 

All  Equal 

All  Equal 

B 

T1B.EC1 

Peacetime>all  the  rest 

All  Equal 

All  Equal 

3 

T1D.EC1 

Peacetime=all  the  rest 

Care>Tech=Bus 

Assumption  #1 

VTC>Real- 

time=Store-and- 

forward 

Table  10  EC  Model  Configurations 

(which  shows  the  three  simulated  evaluation  and  choice  cases  and  their  respective 

model  configurations) 


6.8.1  SAMPLE  MODEL  #1  (EC  BENEFIT  MODEL) 
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Figure  24  Level  I  and  II  of  EC  Model  #1 
(which  shows  EC  Model  #1  Level  I-Goal  and  II-Objectives) 
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Figure  25  EC  Model  #1  Level  II  and  III  -  Peacetime 
(which  shows  EC  Model  #1  Level  II-Objectives  and  Il-(sub)  Objectives  for  peacetime) 
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Figure  26  EC  Model  #1  Level  II  and  III  -  Staffing 
(which  shows  EC  Model  #1  Level  II-Objectives  and  Ill-(sub)  Objectives  for  staffing) 
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Figure  27  EC  MODEL  #1  Technical  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #1  Level  IV  technical  objective  global  weights  for  peacetime) 
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Figure  28  EC  Model  #1  Business  Objective  Global  Weights  (Peacetime) 

(which  shows  EC  Model  #1  Level  IV  business  objective  global  weights  for  peacetime) 
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Figure  29  EC  Model  #1  Delivery  of  Care  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #1  Level  IV  deliver  of  care  objective  global  weights  for  peacetime) 

MODEL  #1  -  SUMMARY  OF  LOCAL  AND  GLOBAL  WEIGHT 
(Note:  Since  the  other  4  Level  II  objectives  are  the  same  weight  (0.2),  their  (sub) 
Objective  weights  are  the  same  as  the  peacetime  (sub)  Objective  weights) 


WEIGHTS 

WEIGHTS 

LEVEL  II  OBJECTIVE 

LOCAL 

GLOBAL 

LEVEL  II  OBJECTIVE 

LOCAL 

GLOBAL  1 

AdonJOB 

0.200 

0.200 

MARKETP 

0.125 

ForceH&F 

0.200 

0.200 

POLITICAL 

0.125 

Footprnt 

0.200 

MOP 

0.125 

0.008 

Staffing 

0.200 

0.200 

PLAN 

0.125 

0.008 

Peacetm 

0.200 

0.200 

USAGE_LVL 

KIEi 

LEVEL  III  -  TECHNICAL 

0.333 

0.067 

PATIENT 

meem 

0.008 

COMPATBL 

0.143 

0.010 

LEVEL  III  -  CARE 

0.067 

RELIABLE 

0.010 

QUALITY 

0.167 

0.011 

PERFORM 

0.010 

EFFICNCY 

1— 

STANDRDS 

0.143 

0.010 

SAFETY 

0.011  1 

UPGRADE 

0.143 

0.010 

APPROVL 

SPEED 

0.143 

0.010 

SATISF 

MULTJJSE 

0.143 

0.010 

SECURE 

0.167 

0.011 

LEVEL  III  -  BUSINESS 

EASE  USE 

0.125 

INTEGRTE 

0.125 

Table  11  Summary  of  EC  Model  #1  Local  and  Global  Weights  (Peacetime) 
(which  shows  the  derived  local  and  global  weights  for  Model  #1) 
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6.8.2  SAMPLE  MODEL  #2  (EC  BENEFIT  MODEL) 
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Figure  30  EC  Model  #2  Level  I  and  II 
(which  shows  EC  Model  #2  Level  I-Goal  and  Level  11-Objectives) 
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Figure  3 1  EC  Model  #2  Levels  II  and  III  (Peacetime) 
(which  shows  EC  Model  #2Level  Il-objectives  and  Ill-(sub)  objectives  for 

peacetime) 
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Figure  32  EC  Model  #2  Level  II  and  III  (Reduce  Staffing) 

(which  shows  EC  Model  #2  Level  II-objective  and  Ill-(sub)  objective  for  staffing) 
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Figure  33  EC  Model  #2  Teclinical  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #2  Level  IV  Teclinical  objective  global 
weights  for  peacetime) 
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Figure  34  EC  Model  #2  Business  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #2  Level  IV  Business  Objective  Global 
weights  for  peacetime) 
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Figure  35  EC  Model  #2  Delivery  of  Care  Objective  Global  Weights  (Peacetime) 
(which  shows  Model  #2  Level  IV  Delivery  of  care  objective  global 
weights  for  peacetime) 
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MODEL  #2  SUMMARY  OF  WEIGHTS 


MODEL  #2  .  , 

WEIGHTS 

WEIGHTS 

LEVEL  II  OBJECTIVE 

LOCAL 

GLOBAL 

LEVEL  II  OBJECTIVE 

LOCAL 

GLOBAL 

AdonJOB 

0.167 

wmm 

MARKETP 

0.125 

ForceH&F 

0.167 

m mm 

POLITICAL 

0.125 
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0.167 

■m 

MOP 
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0.014 

Staffing 

0.167 

mmm 

PLAN 
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0.014 
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0.333 
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0.333 
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COMPATBL 

0.143 

0.016 
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0.333 

jaws™ 
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0.019 

PERFORM 

0.143 

EFFICNCY 

0.019 
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0.016 

SAFETY 

0.019 
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0.016 
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0.019 
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0.143 

0.016 
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0.019 
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0.143 

0.016 

SECURE 

0.167 

0.019 

LEVEL  III  -  BUSINESS 

0.333 

0.111 
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0.014 
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Table  12  Summary  of  EC  Model  #2  Local  and  Global  Weights  (Peacetime) 
(which  shows  the  derived  local  and  global  weights  for  Model  #2) 


6.8.3  SAMPLE  MODEL  #3  (EC  BENEFIT  MODEL-Peacetime) 
6. 8.3.1  Assumptions 

LEVEL  II  OBJECTIVES 


-  All  objectives  are  weighted  equally  i.e.  keeping  active  duty 
forces  on  the  job  is  equally  important  than  peacetime 
objectives 

LEVEL  III  OBJECTIVES 


Delivery  of  care  objectives  are  slightly  more  important  than 
technical  objectives  or  business  objectives. 

-  Business  and  technical  objectives  are  of  equal  importance. 
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LEVEL  IV  BENEFIT  OBJECTIVES 


TECHNICAL  (BENEFIT) 


Group  #1  -  Reliability 

Group  #2  -  Speed  and  Performance 

Group  #3  -  Compatibility,  Multiple  uses,  Standards,  and  Upgrade 

Group  #1  is  equally  to  moderately  more  preferable  to  Group  #2. 
Group  #2  is  equally  to  moderately  more  preferable  to  Group  #3. 
Group  #1  is  moderately  more  preferable  to  Group  #3. 

BUSINESS  (BENEFIT) 

Group  #1  -  Ease  of  Use,  Measures  of  performance,  Management 
or  Project  Plan 

Group  #2  -  Usage  level,  Market  place,  Integrate 
Group  #3  -  Patient  population,  political 

Group  #1  is  equally  to  moderately  more  preferable  to  Group  #2. 
Group  #2  is  equally  to  moderately  more  preferable  to  Group  #3. 
Group  #1  is  moderately  more  preferable  to  Group  #3. 

DELIVERY  OF  CARE  (BENEFIT) 

Group  #1  -  Quality  of  care,  Safety 
Group  #2  -  Efficiency,  Approval 
Group  #3  -  Satisfaction,  security 

Group  #1  is  equally  to  moderately  more  preferable  to  Group  #2. 
Group  #2  is  equally  to  moderately  more  preferable  to  Group  #3. 
Group  #1  is  moderately  more  preferable  to  Group  #3. 

ALTERNATIVES  (BENEFIT) 

Store-and-forward  applications  are  slightly  more  preferable  to 
Real-time  applications 

-  Real-time  applications  are  slightly  more  preferable  to  VTC 
applications 
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6.8.3.2  EC  Model  #3  (Benefit) 


A  benefit  model  can  be  constructed  using  the  pair-wise  comparison 
to  generate  relative  weights  and  finally  global  weights  for  the  three 
alternatives  (YTC,  Real-Time,  and  Store-and-Forward  applications).  The 
EC  model  is  shown  below. 
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Figure  36  EC  Model  #3  Level  I  and  II 

(which  shows  EC  Model  #3  Level  11-Objective  and  Ill-(sub)  Objectives  for  peacetime) 
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Figure  37  EC  Model  #3  of  Technical  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #3  Level  IV  Technical  objective  global  weights  for  peacetime) 
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Figure  38  EC  Model  #3  Business  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #3  Level  IV  Business  objective  global  weights  for  peacetime) 


m 


Expert  Choice:  C: VWORKDA~1  \NEWPHA~1  \AHPM0D~1  VI 3JU13~1  Ml C 


File  Edit  Assessment  Synthesis  Sensitivity-Graphs  Utilities  Help 


CARE:  Delivery  of  care 
objectives 


ifep/F^:ty: 


:A#\ 


I  Local=.5  Global=.5 
ILeveM  Node=30000 


Allocate  Resources  to  Telemedicine  Projects  -  Benefit 


P"go  aiT 

r*  (1 1300) 


•  TTCHNXCI,  \  BUSINESS 


. EFFICNCY 

(01374)  : 
fVTC  . 

I'l  Al.  TME 


l|pjSA| 

J|  (0.135) 
j  VFC 

ISSaltS:'" 


CARE  i 
.  J  (0500) 

APPROVE  1 
7  (0.0743 

vre 

ISEl  tmeTJ 


IS  AND  F 


SATTSf 


SECURE 
(01341)  !  .mil) 


jVTC ' 
ITAL.TMlf 
fe  AND  F 


IVTC 

REAL  TEIE  ' 


|S:AND„F 


!rv“'Vi 


wc 


•  REAL  TME  S  AND  F 


Figure  39  EC  Model  #3  Delivery  of  Care  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #3  Delivery  of  care  objective  global  weights  for  peacetime) 
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MODEL  #3  SUMMARY  OF  WEIGHTS 


,  MODEL  #3 

.  WEIGHTS 

WEIGHTS 

LEVEL  II  OBJECTIVE 

LOCAL 

GLOBAL 

LEVEL  II  OBJECTIVE 

LOCAL 

GLOBAL 

AdonJOB 

0.200 

MARKETP 

g^gggfl 

ForceH&F 

POLITICAL 

HIM 

Footprnt 

0.200 

0.200 

MOP 

0.192 

0.048 

Staffing 

0.200 

PLAN 

Bmfl 

Peacetm 

0.200 

USAGE_LVL 

LEVEL  III  -  TECHNICAL 

0.250 

0.250 

PATIENT 

0.103 

0.026 

COMPATBL 

0.090 

0.022 

LEVEL  III  -  CARE 

0.500 

0.500 

RELIABLE 

QUALITY 

0.270 

0.135 

PERFORM 

0.173 

EFFICNCY 

0.148 

0.074 

STANDRDS 

0.022 

SAFETY 

0.135 

UPGRADE 

APPROVL 

SPEED 

SATISF 

0.041 

MULTJJSE 

SECURE 

0.082 

0.041 

LEVEL  III  -  BUSINESS 

EASE  USE 

0.192 

INTEGRTE 

Table  13  Summary  of  EC  Model  #2  Local  and  Global  Weights  (Peacetime) 
(which  shows  the  derived  local  and  global  weights  for  Model  #3) 


6.8.33  Sensitivity  Analysis  (Benefit  Model) 

Sensitivity  analysis  is  used  to  investigate  the  sensitivity  of  the 
alternatives  to  changes  in  the  priorities  of  the  criteria.  Sensitivity  analyses 
are  started  from  the  Sensitivity-Graphs  command  on  the  main  menu  of 
Evaluation  and  Choice.  Sensitivity  and  Sensitivity-Graphs  both  refer  to 
the  same  sensitivity  analysis  features  of  Evaluation  and  Choice. 

Sensitivity  analysis  from  the  GOAL  node  will  show  the  sensitivity 
of  alternatives  with  respect  to  the  criteria  immediately  below  the  goal. 
Sensitivity  analysis  can  also  be  invoked  from  nodes  farther  down  in  the 
tree  if  the  model  has  more  than  three  levels.  When  the  sensitivity  analysis 
is  performed  from,  for  example,  a  criterion  node  immediately  below  the 
goal,  the  sensitivity  is  with  respect  to  the  (sub)  criteria  below  the  criterion 
node.  There  are  five  graphical  sensitivity  analysis  modes: 

Performance 

-  Dynamic 
Gradient 

-  2D  Plot  (Two-Dimensional) 

-  Differences 
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All  five  graphical  sensitivity  modes  provide  views  of  priorities  and 
alternatives  in  the  model  and  how  they  are  related.  The  views  available  in 
the  different  modes  provide  emphasize  on  different  aspects  of  the  model's 
priorities.  Though  all  views  of  the  model's  include  criteria  and 
alternatives,  what  is  emphasized  in  the  graphical  visualization  for  the 
sensitivity  modes  varies.  For  example,  “Differences”  emphasizes  the 
differences  between  the  alternatives  given  the  criteria  while  the  “2-D  Plot” 
emphasize  the  relationships  between  criteria  as  they  apply  to  the 
alternatives  in  the  model.  The  sensitivity  analysis  modes  are  not  designed 
to  provide  different  substantive  alternatives  for  altering  the  model  —  the 
structure  of  the  model  itself  is  a  model  building  issue.  Additionally, 
priority  adjustments  made  for  sensitivity  analysis  in  one  open  mode  are 
reflected  in  all  the  currently  open  sensitivity  modes  for  the  model.  Each 
mode  has  a  status  bar  at  the  bottom  of  the  screen  that  tells  the  type  of 
sensitivity  being  viewed,  whether  the  synthesis  was  performed  in 
Distributive  or  Ideal  mode,  as  well  as  the  date  and  time. 


An  example  of  performance  sensitivity  analysis  is  shown  with  the 
technical  (sub)  objective  with  respect  to  the  goal.  Figure  40  shows  all  five 
sensitivity  analysis  for  EC  Model  #3  for  the  technical  criteria  with  respect 
to  the  goal.  The  following  example  shows  how  sensitivity  analysis  may 
be  performed. 
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Figure  40  Original  EC  Model  #  3  Sensitivity  Analysis 
(which  shows  the  original  technical  and  performance  objective  weights 

with  respect  to  the  goal) 
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PERFORMANCE  GRAPH 


|||  Sensitivity  Analysis  -  [Performance] 


Figure  41  New  Model  #3  Performance  Graph 
(which  shows  the  relative  weights  of  the  new  technical  and  performance  objective) 

The  performance  graph  displays  all  the  information  about  how 
alternatives  behave  vis-a-vis  each  criterion  on  a  single  screen.  This  is  the 
most  compact  presentation  of  the  information  about  the  priorities.  Figure 
40  shows  the  original  weights  of  the  technical  objectives  and  Figure  41 
shows  the  new  relative  weights  by  moving  the  desired  vertical  bar.  In  this 
case,  the  “RELIABLE”  bar  was  increased  from  29.4%  to  31.8%  and  the 
“PERFORMANCE”  bar  was  increased  from  17.3%  to  34.1%. 

The  performance  graph  provides  a  composite  sensitivity 
presentation  showing  how  well  each  alternative  performs  on  each  criterion 
and  overall,  when  all  the  criteria  are  taken  into  account.  Each  criterion  (in 
this  case,  technical,  business,  and  care  objective)  is  shown  by  a  vertical 
line.  The  point  where  an  alternative  line  intersects  such  a  vertical  line,  as 
read  from  the  axis  on  the  right  (labeled  "Alt%"),  indicates  the  priority  the 
alternative  received  on  that  criterion.  In  this  case,  the  Store-and-Forward 
green  line  intersects  the  right  axis  at  the  29. 1%.  The  overall  priority  of 
each  alternative  is  where  it  intersects  the  rightmost  axis. 

The  priority  of  each  criterion  is  shown  by  the  small  blue 
rectangular  box  on  that  criterion's  vertical  line,  as  read  from  the  axis  at  the 
left  (labeled  Crit%).  What-If  analysis  is  done  by  dragging  the  box  up  and 
down  the  vertical  line  to  change  the  priority  of  the  criterion.  As  the 
priority  changes,  the  overall  priorities  of  the  alternatives  on  the  axis  at  the 
right  change  and  the  other  priorities  are  readjusted  to  accommodate  the 
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changes.  In  this  case,  changing  the  criteria  level  will  not  affect  the 
weighting  of  the  alternatives  but  the  weighting  of  the  criteria  that  will  be 
used  in  the  Ratings  Model.  The  next  point  may  seem  obvious  but  it  is 
important  to  distinguish  which  pair-wise  comparison  changes  which 
local/global  weights.  The  weighting  of  the  alternatives  are  changed  not 
through  the  pair-wise  comparison  of  the  criteria  (reliability,  performance, 
etc.)  but  through  the  changing  the  pair-wise  comparison  of  the  alternatives 
(VTC,  Real-Time,  Store-and-Forward).  Therefore,  Figure  42  shows  the 
result  of  increasing  the  reliability  and  performance  criteria.  All  the  other 
criteria  weights  have  decreased  in  response  to  this  What-If  scenario. 
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Figure  42  New  EC  Model  #3  Sensitivity  Analysis 
(Which  shows  the  resulting  weights  of  increasing  the  reliability  and 

performance  criteria) 

Now  back  to  the  original  Model  #3  configuration  and  assumptions. 
In  summary,  the  sample  EC  model  shows  that  the  following  proportion  of 
resources  should  be  allocated  to  VTC,  Real-Time,  and  Store-and-Forward 
telemedicine  applications. 

Assumption  -  Initial  allocation  $50M 
OBJECTIVES  Global  Weights  Funding  Amount 


-  Active  Duty  Forces  on  the  Job 

0.2 

$10M 

-  Force  Health  and  Fitness 

0.2 

$10M 

-  Reduce  Footprint 

0.2 

$10M 

-  Reduce  Staffing 

0.2 

$10M 

-  Peacetime 

02 

$10M 

TOTAL 

1.0 

$50M 
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Global  Weights  with  respect  to 


ALTERNATIVES  Peacetime 

Goal 

Funding  Amount 

-  VTC  Applications 

0.540 

0.1080 

$5.40M 

-  Real-Time  Applications 

0.297 

0.0594 

$2.97M 

Store-and-Forward  Appl. 

0.163 

0.0326 

$1.63M 

TOTAL 

1.000 

0.2000 

$10. 0M 

6.8.4  SAMPLE  MODEL  #4  (EC  COST  MODEL  -  PEACETIME) 
6. 8.4.1  Assumptions 

LEVEL  II  OBJECTIVES 


-  All  objectives  are  weighted  equally  i.e.  keeping  active  duty  forces 
on  the  job  is  equally  important  than  peacetime  objectives 

LEVEL  III  OBJECTIVES 

-  Delivery  of  care  objectives  are  slightly  more  important  than 
technical  objectives  or  business  objectives. 

-  Business  and  technical  objectives  are  of  equal  importance. 
LEVEL  IV  COST  OBJECTIVES 

TECHNICAL  (COST) 

Group  #1  -  Size,  Weight 

Group  #2  -  Maintenance  (Maintain),  Custom 

Group  #3  -  Assembly 

Group  #1  is  equally  to  moderately  more  preferable  to  Group  #2. 
Group  #2  is  equally  to  moderately  more  preferable  to  Group  #3. 
Group  #1  is  moderately  more  preferable  to  Group  #3. 

BUSINESS  (COST) 

Group  #1  -  On-going  Capital,  Schedule,  Transmission  $ 

Group  #2  -  Initial  capital,  Training 
Group  #3  -  Facility 

Group  #1  is  equally  to  moderately  more  preferable  to  Group  #2. 
Group  #2  is  equally  to  moderately  more  preferable  to  Group  #3. 
Group  #1  is  moderately  more  preferable  to  Group  #3. 
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DELIVERY  OF  CARE  (COST) 


Group  #1  -  Clinician  Inconvenience,  Patient  Discomfort,  Patient 
Movement 

Group  #2  -  Patient  Inconvenience,  Patient  Confinement 
Group  #3  -  Patient  Delays 

Group  #1  is  equally  to  moderately  more  preferable  to  Group  #2. 
Group  #2  is  equally  to  moderately  more  preferable  to  Group  #3. 
Group  #1  is  moderately  more  preferable  to  Group  #3. 


6. 8.4.2  EC  MODEL  #4  (COST  MODEL) 


A  benefit  model  can  be  constructed  using  the  pair-wise  comparison 
to  generate  relative  weights  and  finally  global  weights.  A  sample  EC  cost 
model  is  shown  in  Figure  43  below. 
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Figure  43  EC  MODEL  #4  Level  I  and  II  (Peacetime) 
(which  shows  EC  Model  #4  Level  LGoal  and  Il-Sub(objectives)  for  peacetime) 
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Figure  44  EC  Model  #4  of  Technical  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #4  Level  IV  Technical  Objective  global  weights  for  peacetime) 
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Figure  45  EC  Model  #4  of  Business  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #4  Level  IV  Business  objective  global  weights  for  peacetime) 
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6.8.5  EC  MODEL  #5  (RISK  MODEL) 

LEVEL  II  OBJECTIVES 

-  All  objectives  are  weighted  equally  i.e.  keeping  active  duty  forces 
on  the  job  is  equally  important  than  peacetime  objectives 

LEVEL  III  OBJECTIVES 

-  Delivery  of  care  objectives  are  slightly  more  important  than 
technical  objectives  or  business  objectives. 

Business  and  technical  objectives  are  of  equal  importance. 

LEVEL  IV  RISK  OBJECTIVES 

-  Technical  risk  is  slightly  more  likely  than  Cost  risk 
Cost  risk  is  slightly  more  likely  than  Schedule  risk 

-  Technical  risk  is  moderately  more  likely  than  Schedule  risk 
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Figure  47  EC  Model  #5  Level  I  and  II 
(which  shows  EC  Model  #5  Level  I-Goal  and  II-Objectives) 
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Figure  48  EC  Model  #5  Technical  Risk  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #5  Technical  risk  objective  global  weights  for  peacetime) 
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Figure  49  EC  Model  #5  Cost  Risk  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #5  Cost  risk  objective  global  weights  for  peacetime) 
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Figure  50  EC  Model  #5  Schedule  Risk  Objective  Global  Weights  (Peacetime) 
(which  shows  EC  Model  #5  Schedule  risk  objective  global  weights  for  peacetime) 
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6.8.6  RATINGS  MODEL 


Now  that  the  global  weights  have  been  derived,  the  benefit,  cost,  and  risk 
models  may  be  used  to  evaluate  the  various  initiatives.  Since  there  is  insufficient 
data  from  data  collection,  four  simulated  VTC  Projects  (VTC  Project  A,  B,  C,  and 
D)  were  analyzed  using  the  telemedicine  assessment  tool.  Figure  51  shows  the 
sample  entries  for  a  benefit  ratings  model  for  VTC  Project  A  with  respect  to 
Compatibility. 
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Figure  51  Sample  VTC  Ratings  Model  for  Benefits 
(which  shows  the  evaluation  of  sample  VTC  Projects  using  benefit  objectives) 


Similarly,  each  initiative  may  be  evaluated  using  the  associated  intensity 
levels.  The  ratings  model  automatically  calculates  the  total  weights  (under  the 
TOTAL  heading).  In  addition,  the  cost  of  each  of  the  projects  may  also  be  added 
in  an  addition  column  (COST)  which  is  not  shown  above.  The  complete 
simulated  data  for  sample  VTC  Projects  A-D  is  shown  in  Table  14. 
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ALTERNATIVE 

TOTAL 

COMPATBL 

RELIABLE 

PERFORM 

STANDRDS 

UPGRADE 

VTC  Project  A 

0.819 

H_Compat 

H_Reliab 

E_Perfm 

A_Std 

EaseJJG 

0.532 

M_Compat 

M_Reliab 

G_Perfm 

M_Std 

Ease_UG 

VTC  Project  C 

B_Compat 

B_Reliab 

A_Perfm 

S_Std 

M_UG 

VTC  Project  D 

0.224 

N_Compat 

N_Reliab 

B_Perfm 

N_Std 

N_UG 

ALTERNATIVE 

SPEED 

MULT  USE 

EASE  USE 

POLITICL 

USGE  LVL 

PATIENT 

VTC  Project  A 

T1 

M4_USE 

V_Easy 

H_Supprt 

HJJsed 

AD_PT 

VTC  Project  B 

ISDN 

3_USE 

M_Easy 

M_Supprt 

M_Used 

DEP_PT 

Telephn 

2JJSE 

N_Easy 

M_Supprt 

A_Used 

RET_PT 

S_Modems 

S_USE 

VD_Easy 

N_Supprt 

B_Used 

OTHER_PT 

ALTERNATIVE 

INTEGRTE 

MOP 

PLAN 

QUALITY 

EFFICNCY 

SAFETY 

VTC  Project  A 

FJntegr 

Y_MOP 

Y_Plan 

HI_Qual 

Ml _ Effic 

AS_Safe 

VTC  Project  B 

FJntegr 

Y_MOP 

N_Plan 

MI_Qual 

Bl _ Effic 

AS_Safe 

VTC  Project  C 

DJntegr 

N_MOP 

N_Plan 

BI_Qual 

BI_Effic 

N_Safe 

VTC  Project  D 

NJntegr 

NI_Qual 

NI_Effic 

N_Safe 

ALTERNATIVE 

APPROVL 

SATISF 

SECURE 

VTC  Project  A 

OG_Appr 

M_Sat 

VTC  Project  B 

U_Secure 

VTC  Project  C 

B_Sat 

U_Secure 

VTC  Project  D 

N_Appr 

U_Sat 

U_Secure 

Table  14  Simulated  Benefit  Ratings  data  for  VTC  Projects 
(which  shows  an  evaluation  of  sample  VTC  Projects  using  benefit  objectives) 


Similarly,  the  VTC  Projects  may  be  evaluated  using  the  cost  and  risk  models 

shown  below. 
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Figure  52  Sample  VTC  Ratings  Model  for  Cost  (Peacetime) 

(which  shows  the  evaluation  of  sample  VTC  Projects  using  cost  objectives) 
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ALTERNATIVE 

TOTAL 

MAINTAIN 

SIZE 

WEIGHT 

ASSMBLY 

CUSTOM 

VTC  Project  A 

0.371 

L_Maintn 

Neg_Sz 

VL_Wt 

E_Asmbly 

COTS/GOT 

0.404 

A_Maintn 

Port_Sz 

L_Wt 

E_Asmbly 

ENH_COTS 

VTC  Project  C 

0.522 

M_Maintn 

Port_Sz 

A_Wt 

M_Asmbly 

ENH_COTS 

VTC  Project  D 

0.697 

H_Maintn 

Fixed_Sz 

Mod_Wt 

D_Asmbly 

CUS_EQ 

ALTERNATIVE 

ICAPITAL 

OCAPITAL 

TRAINING 

FACILITY 

SCHEDUL 

TRANSS 

VTC  Project  A 

VLJCAP 

S_OCAP 

eh 

Ded_Fac 

N_Sched 

M_Transm 

VTC  Project  B 

LJCAP 

msssm 

L_FloorS 

N_Sched 

M_Transm 

VTC  Project  C 

MJCAP 

L_OCAP 

M_T  rng 

M_FloorS 

Y_Sched 

L_Transm 

VTC  Project  D 

SJCAP 

VL_OCAP 

L_Trng 

S_FloorS 

Y_Sched 

L_Transm 

■Hi 

ALTERNATIVE 

DISCMFT 

PJNCONV 

CJNCONV 

MOVEMNT 

CONFINE 

VTC  Project  A 

L_Discmf 

M_PIConv 

S_CIConv 

S_Delay 

L_Move 

S_Confn 

VTC  Project  B 

L_Discmf 

M_PIConv 

S_CIConv 

L_Move 

L_Confn 

VTC  Project  C 

S_Discmf 

S_PIConv 

S_CIConv 

S_Move 

L_Confn 

VTC  Project  D 

S Discmf 

S PIConv 

S CIConv 

S Delay 

M Move 

L Confn 

Table  15  Simulated  Cost  Ratings  data  for  VTC  Projects 
(which  shows  the  evaluation  of  sample  VTC  Projects  using  cost  objectives) 
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Figure  53  Simulated  Risk  Ratings  for  VTC  Projects 
((which  shows  the  evaluation  of  sample  VTC  Projects  using  risk  objectives) 
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Iii  Summary,  the  simulated  VTC  Projects  have  the  following  total 
weightings: 


VTC  Project  A 

0.819 

0.371 

0.132 

VTC  Project  B 

0.532 

0.404 

0.206 

VTC  Project  C 

0.321 

0.522 

0.354 

VTC  Project  D 

0.224 

0.697 

0.582 

Table  16  Summary  of  simulated  weights 
(which  shows  the  relative  weights  for  the  sample  VTC  Projects) 


6.8.7  Resource  Allocation  Application 

COST-BENEFIT  ANALYSIS 

A  cost-benefit  analysis  may  now  be  performed  using  the  equation: 

_  Benefit 
Cost 

And  a  cost-benefit-risk  analysis  may  use  the  equation: 

_  Benefit 
Cost*  Risk 


PROPJECTS 

Benefit/Cost 

Benefit-Cost-Risk 

Ranking 

VTC  Project  A 

2.208 

16.724 

1 

VTC  Project  B 

6.392 

2 

VTC  Project  C 

■nni 

1.737 

3 

VTC  Project  D 

0.321 

0.552 

4 

Table  17  Simulated  project  analysis  and  ranking 
(which  shows  the  results  of  cost-benefit,  benefit-cost-risk  analysis) 

If  the  actual  initial  investment  for  the  VTC  Projects  are: 

VTC  Project  A  $500,000 

VTC  Project  B  $350,000 

VTC  Project  C  $250,000 

VTC  Project  D  $100,000 
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The  efficiency  frontier  may  be  plotted.  The  efficiency  frontier  has 
the  values  of  total  cost  ($)  on  the  horizontal  axis  and  the  cumulative 
Benefit/Cost  Ratio  on  the  vertical  axis.  See  Figure  54  for  the  efficiency 
frontier  for  the  sample  VTC  projects. 

Sample  Efficiency  Frontier 


Cumulative  B/C  Ratio 


Figure  54  Simulated  Efficiency  Frontier 
(which  shows  the  simulated  efficiency  frontier  for  the  VTC  Projects) 


MAXIMIZATION  OF  BENEFITS  -  OPTIMIZATION 


The  solver  tool  in  Microsoft’s  EXCEL  may  be  used  to  find  the 
combination  of  projects  or  activities  that  maximizes  the  total  benefits 
without  exceeding  the  budget.  This  problem  can  be  formulated  as  a  zero- 
one  integer  mathematical  programming  problem,  sometimes  referred  to  as 
a  knapsack  problem.  Mathematically,  the  optimization  problem  in  this 
simulation  is  as  follows: 

Maximize  .819Xj+  .532X2+  .321X4+  .224X4  (Benefits) 

Subject  to  ,371Xi+  X2+  X4+  0.697X4  <  $1M  (Cost) 

Note:  $1M  is  the  total  budget  (Constraint) 

where  Xi,  X2,  X4,  and  X4  >0 

and  Xi,  X2,  X4,  and  X4  >1 

and  Xi,  X2,  X4,  and  X4  are  integers. 

Therefore,  VTC  Projects  A,  B,  should  be  funded  if  the  sample  total  budget 
is  $1M.  Other  budget  levels  resource  allocation  may  be  easily  generated  using 
this  technique  as  well. 
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7. 


FINDINGS 


7.1  VIRTUALLY  NO  TELEMEDICINE  SYSTEMS  WERE  OPERATIONAL 
AT  THE  TIME  OF  REL  DATA  COLLECTION. 

During  the  period  of  data  collection,  January  2,  1998  to  March  31,  1998, 
TRICARE  Region  6  experienced  difficulty  in  bringing  the  dial-anywhere 
capability  on-line.  In  fact,  shortly  after  the  transition  from  the  old  to  new  BAMC, 
the  telemedicine  communications  infrastructure  had  experienced  numerous 
difficulties,  including  service  interruptions,  which  undermined  the  clinical 
reliability  of  the  system.  At  the  time  of  the  data  collection,  only  the  VTC 
applications  and  the  directly  connected  lines  (without  routing  through  the 
TELEOS  switch)  were  in  operation. 

Complaints  were  also  noted  regarding  the  difficulty  in  employing  the 
mobile  telemedicine  units  because  of  their  large  and  cumbersome  configuration, 
long  set-up  time  and  inaccessible  operational  controls  especially  for  the  clinical 
staff  when  trying  to  use  them.  Technical  staff  members  were  very  industrious  in 
their  attempts  to  troubleshoot  the  malfunctioning  of  a  system,  which  they  had 
previously  issued  by  force.  Some  of  the  "Store-and-Forward"  systems  in 
radiology  and  pathology  were  being  used  by  DACH  and  BAMC  personnel  and 
were  regarded  as  helpful;  however,  no  recorded  data  was  available  to  support 
their  effectiveness.  Other  telemedicine  applications  such  as  administrative 
teleconferencing  and  educational  tutorial  link-ups  with  local  educational 
institutions  were  regarded  by  many  of  the  interviewees  as  very  positive  and 
beneficial;  however,  the  benefits  were  not  quantified. 


7.2  THERE  WAS  NOT  MUCH  DATA  AVAILABLE  AND  WHAT  WAS 
AVAILABLE  WAS  NOT  WHAT  WAS  NEEDED. 

"Although  there  are  many  individuals  who  believe  strongly  in  the  potential 
for  telemedicine  to  provide  timely  and  cost-effective  support,  little  "hard  data"  is 
available  to  support  that  belief."  This  statement,  from  the  Joint  Working  Group 
on  Telemedicine  (JWGT)  in  January  1997,  still  applies  at  the  finalization  of  the 
REL  report  concerning  the  initiatives  in  Region  6.  The  inability  of  the 
telemedicine  support  systems  to  perform  reliably  contributed  adversely  to  the  data 
collection  and  tracking  within  the  Region.  Even  the  administrative  VTC  and 
other  working  telemedicine  initiative  such  as  tele-education  did  not  have 
meaningful  data  recorded  to  assess  effectiveness.  While  some  TV  tapes  were 
available,  no  analysis  of  content  and  relevance  had  been  done. 

At  the  MEDNET,  the  center  of  the  telemedicine  DS-3  network  in  the 
Region,  REL  found  partial  data  including  network  load  capacity,  security  related 
information  and  call  duration  reports.  Although  the  call  duration  reports  are 
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valuable  for  showing  the  origination  and  termination  of  every  call  from  a  node, 
the  connection  time  and  duration  of  the  call,  the  collection  reports  do  not  indicate 
the  clinical  or  administrative  content  or  value.  In  other  words,  the  report  indicates 
calls  occurring  from  the  radiology  department  but  does  not  indicate  the  nature  of 
the  clinical  or  non-clinical  activity. 

There  is  a  clear  need  for  both  quantitative  and  qualitative  "hard  data"  to  be 
systematically  gathered  over  time  to  show  telemedicine  clinical  effectiveness  and 
supportability  against  the  AMEDD  success  criteria.  This  data,  when  captured  and 
applied  to  the  AHP  Expert  Choice  software  will  help  shape  informed,  pragmatic 
decisions.  It  is  apparent  from  Section  6  of  this  report  concerning  data  collection, 
that  the  statement  of  Dr.  Ernest  H.  Foreman  applies,  "The  data  we  have  is  not 
what  we  need.  The  data  that  we  need  is  not  what  we  have"47.  To  help  develop  a 
comprehensive  and  supportable  solution,  clinical  users  must  be  involved  in  the 
development  of  the  data  collection  plan  and  collection  profile  to  insure  that  they 
make  sense  to  them  as  users  as  well  as  efficiently  capturing  the  necessary  data 
with  the  minimum  disruption  and  additional  work. 


7.3  IT  WAS  DIFFICULT  TO  DETERMINE  RELATIVE  IMPORTANCE  AND 
WEIGHTING  FACTORS  NEEDED  TO  EVALUATE  THE  AMEDD 
INITIATIVES  IN  REGION  6. 

The  general  lack  of  pertinent  data  also  contributed  to  the  problem  of 
determining  relative  preference,  importance,  and  value.  It  was  unclear  from  the 
lack  of  AMEDD  administrative  documentation  of  what  were  the  individual 
initiative’s  objectives  and  measures  of  performance.  Hence,  it  was  not  possible 
analytically  to  determine  which  objectives  were  important  and  by  how  much.  The 
founding  vision  of  "The  hospital  without  walls"  does  not  provide  the  specificity  to 
support  the  input  parameters  needed  to  assess  the  initiatives  using  the  AHP 
assessment  tool. 

Moreover,  the  31 -telemedicine  initiatives  were  not  a  result  of  a 
prioritization  process  to  identify  relative  weightings  essential  for  meaningful 
inputs  to  the  AHP  decision  support  process.  As  described  in  a  number  of  site 
interviews  at  DACH  and  BAMC,  the  final  decision  for  past  telemedicine 
equipment  purchases  may  have  been  dictated  by  the  promotional  persuasions  of 
the  vendor  done  at  higher  headquarters  rather  than  with  the  actual  clinician  user. 
Therefore,  it  is  difficult  to  extract  from  data  collection,  which  of  the  objectives 
were  truly  important  since  the  original  recommendations  for  vendor  selection  and 
capabilities  were  not  provided.  What  was  clear  was  a  universal  unhappiness  with 
the  fielded  system. 


47  REL  interview  with  Dr.  Ernest  H.  Forman  at  his  George  Washington  University  office,  1 0  JUN  98 
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REL  also  observed  that  clinicians  had  a  hard  time  reaching  judgments 
about  what  factors  were  more  important  which  is  a  typical  issue  with  decision¬ 
making  problem  sets.  For  example,  some  did  not  want  to  clearly  state  that  the 
system  reliability  factors  are  more  important  than  the  system  performance.  And  if 
so,  by  how  much?  However,  the  information  concerning  the  importance  of 
clinical  convenience  may  be  inferred  from  statements  such  as  "Even  if  it  (the 
system)  worked,  I  wouldn't  use  it  because  of  the  inconvenience  of  having  to 
schedule  the  sessions."  Although  REL  gathered  a  few  of  these  anecdotal 
statements  during  the  on-site  interviews,  there  was  clearly  not  enough  information 
to  derive  the  weights  for  entry  into  the  assessment  tool.  The  overall  lack  of 
quantifiable,  weighted  data  precluded  the  application  of  the  AHP  assessment  tool. 


7.4  THERE  IS  NO  UP-TO-DATE,  COMPREHENSIVE  AND  DOCUMENTED 
BUSINESS  PLAN  FOR  REGION  6. 

DACH  did  develop  a  partial  telemedicine  business  plan  (see  Appendix  N) 
which  was  the  only  available  published  plan.  While  it  represents  a  very  useful 
first  step,  the  plan  falls  short  of  being  a  complete  roadmap  since  it  did  not  include 
a  detailed  needs  assessment  and  market  situation  analysis,  business  strategy, 
marketing  strategy,  operational  strategy,  organizational  structure  and  financial 
strategy  necessary  to  rationally  drive  the  next  steps.  However,  there  is  clear 
evidence  that  considerable  "hands-on"  expertise  exists  in  Region  6  to  help 
develop  a  business  plan.  The  initial  investment  in  developing  a  good  business 
plan  based  on  AHP  will  be  essential  to  the  follow-on  years  of  telemedicine 
research,  development  and  implementation  as  well  as  being  responsive  to  the 
concerns  pointed  out  in  the  GAO  Telemedicine  Report48. 


7.5  THE  31  INITIATIVES  WITHIN  REGION  6  ARE  UNFOCUSED  AND  DID 
NOT  HAVE  INDIVIDUAL  PROJECT  MANAGEMENT  PLANS. 

The  individual  initiatives  did  not  have  a  clear  project  management  focus 
and  lines  of  responsibility  to  implement  the  initial  vision.  In  fact,  it  was  difficult 
to  determine  the  cornerstones  of  project  management  e.g.  the  mission,  the 
objectives,  the  measures  of  performance,  the  milestones,  and  the  constraints  (time, 
schedule,  and  cost).  Therefore,  it  was  difficult  to  identify  the  documented 
analyses  of  benefits  as  well  as  the  costs  and  associated  risks.  Moreover,  the  lack 
of  an  operative  cost  accounting  system  made  the  financial  tracking  of  each 
initiative  impossible.  A  project  management  plan  is  essential  in  determining  the 
AMEDD  value  for  each  initiative  as  well  as  for  comparison  among  initiatives. 


48  GAO  Report. 
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7.6  TELEMEDICINE  INFORMATION  IS  BEING  SHARED  WITHIN 
REGION  6. 

The  telemedicine  working  group,  chaired  by  LTC  Darryl  Zeigler  conducts 
meetings  on  a  monthly  basis  with  representatives  from  across  the  Region  to 
discuss  telemedicine  issues.  These  sessions  are  helpful  not  only  in  discussing 
current  issues  but  also  provide  a  forum  for  problem  identification  and  potential 
resolution.  These  meetings  represent  a  positive  means  for  informal  data 
collection,  knowledge  management,  and  professional  communication.  Also,  the 
working  group  notes  can  certainly  serve  as  pre-marketing  insights  for  future 
business  planning  in  the  region.  These  meetings  are  well  attended  and  clearly 
demonstrate  commitment  by  the  concerned  clinician  professionals  to  finding 
constructive  and  affordable  telemedicine  solutions  for  Region  6. 

7.7  THERE  IS  CLINICIAN  INTEREST  IN  LEVERAGING  TELEMEDICINE 
AND  INFORMATION  TECHNOLOGY  TO  ENHANCE  QUALITY  AND 
EFFICIENCY  OF  CARE  WITH  USERS  LOOKING  FORWARD  TO  A 
MEANINGFUL  ROLE  IN  THE  DECISION  PROCESS  FOR  THE 
ADOPTION  OF  FUTURE  TECHNOLOGY  APPLICATIONS. 

A  REL  lesson  learned  is  that  for  any  new  technology,  selected,  purchased 
and  then  taken  out  of  the  box,  still  requires  a  certain  level  (sometimes  moderate  to 
extensive)  technical  support  which  can  be  a  heavy  burden  on  the  existing  staff  if 
not  adequately  planned  and  properly  resourced.  Even  though  personnel  in  Region 
6  have  had  negative  experiences  with  previous  telemedicine  projects,  there  is  still 
strong  interest  expressed  during  site  interviews  in  leveraging  not  only  the  promise 
of  telemedicine  but  also  more  broadly  information  management  technology  to 
enhance  efficiency  and  quality  of  care  in  the  face  of  shrinking  resources.  The 
following  example  demonstrates  a  potential  application: 

A  psychiatrist  at  DACH  proposed  to  project  the  medical  expertise 
out  from  regional  centers  via  remote  access  to  soldiers  and  families  at  Ft. 
Hood,  Texas  and  Ft.  Leavenworth,  Kansas.  He  spoke  of  the  tremendous 
opportunity  to  meet  the  need  for  conducting  remote  psychiatric  crisis 
interventions  from  Fort  Hood  to  Fort  Leavenworth  via  a  low-cost  desktop 
video  phone  which  would  help  offset  cutbacks  in  the  hiring  of 
psychiatrists  while  the  incidence  of  crises  situations  involving  drug  abuse, 
marital  conflict,  family  separation  anxiety  and  sexual  harassment 
continues  to  rise. 
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The  psychiatrist  believed  that  a  low-cost  teleconsultation  system 
($500.00)  would  provide  the  means  for  timely  clinician  access  to  the 
person  in  crisis.  He  further  observed  that  the  existing  telemedicine 
infrastructure  was  a  negative  capability  since  it  required  too  much  setup 
time  and  was  extremely  unwieldy  to  move  around  the  hospital.  REL 
observed  that  clinicians  work  extremely  hard  to  keep  up  with  their 
burgeoning  patient  load  and  were  naturally  hesitant  to  adopt  any  new 
practice,  which  could  end  up  being  an  additional  burden.  This  was 
particularly  true  if  an  old  and  new  system  would  have  to  be  maintained 
concurrently,  especially  without  the  proper  training  and  technical  and 
maintenance  support  for  either  system.  The  clinicians  made  it  clear  that 
they  wanted  to  be  involved  in  the  decision  process  for  future  technological 
applications. 
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8.0  RECOMMENDATIONS 


8.1  CONDUCT  SPECIFIC  DECISION-MAKING  SESSIONS  SUPPORTED  BY 
AN  AHP  EXPERT  CHOICE  TOOL  TO  VERIFY  THE  PRELIMINARY 
TELEMEDICINE  OBJECTIVES  WITH  THE  PURPOSE  OF 
SYNTHESIZING  RELATIVE  PRIORITIES  AND  WEIGHTS  TO 
SUPPORT  THE  AHP  MODEL. 

To  be  meaningful,  these  sessions  must  be  conducted  with  decision-makers 
and  the  clinician  practitioners  of  telemedicine  to  address  the  different  clinical 
domains  and  their  support  functions  across  the  AMEDD  so  that  a  comprehensive 
profile  of  the  potential  application  of  telemedicine  can  be  determined. 

8.2  INITIATE  DATA  COLLECTION  WITHIN  REGION  6  TO  SUPPORT  THE 
AHP  MODEL  DATA  INPUT. 

Employing  the  REL  Technology  Profile,  clinical  domains  and  associated 
administrative  and  technical  support  staff  and  clinical  users  must  be  queried  in 
order  to  complete  and  refine  the  data  collection  to  support  the  AHP.  Coordination 
is  needed  with  the  MEDNET  NOD  so  that  all  telemedicine  activities  eventually 
exported  to  the  other  Regions,  such  as  pathology  and  radiology,  can  be  monitored 
and  assessed.  Although  the  focus  of  the  analysis  should  be  on  Region  6,  the 
implicit  advantage  of  telemedicine  is  its  ability  to  distribute  clinical  activity 
throughout  the  AMEDD  in  real-time  or  by  store  and  forward  means.  The  capture 
of  qualitative  and  quantitative  data  is  the  required  input  necessary  to  synthesize 
the  AHP  model. 


8.3  RE-EVALUATE  EXISTING  TELEMEDICINE  EQUIPMENT  WITHIN 
THE  REGION  TO  ASSESS  EFFECTIVENESS  FOR  CURRENT  AND 
FUTURE  NEEDS  AND  WITH  CLINICIANS  PARTICIPATING  FULLY  IN 
THE  EVALUATION  PROCESS. 

After  the  22  mobile  NEC  telemedicine  units  are  operational,  a  timely  and 
comprehensive  evaluation  of  all  the  telemedicine  systems  should  be  conducted  to 
assess  effectiveness  from  both  the  patient  and  clinician's  perspective  as  well  as  the 
service  supporter.  Vendor  involvement  must  be  minimized  in  the  assessment  to 
determine  true  cost-benefit-risk  as  criteria  for  the  AEIP  model. 


8.4 


ADOPT  A  PROJECT  MANAGEMENT  FOCUS  AT  THE  INITIATIVE 
LEVEL. 


A  consistent  standard  of  project  management  tools  for  organization, 
concepts  and  documentation  should  be  applied  to  ensure  that  business  models 
meet  the  clinician  and  decision-makers  needs.  Standard  methodology  of  project 
management  planning  with  the  constraints  of  cost,  schedule,  performance, 
milestones  and  deliverables  should  implemented.  Project  management 
involvement  should  begin  at  inception  and  continue  throughout  the  life  of  the 
entire  project. 


8.5  CONDUCT  PERIODIC  PROJECT  AUDITS  TO  ASSESS  THE  RETURN¬ 
ON  INVESTMENT  AND  CAPTURE  LESSONS  LEARNED  FOR  LONG¬ 
TERM  IMPROVEMENT  WITHIN  THE  REGION. 

This  control  and  feedback  function  is  also  critical  to  the  overall 
stewardship  of  the  project  leading  to  success  in  implementing  effective  and 
affordable  solutions  for  the  AMEDD  community  long-term.  To  be  sustainable 
and  supportable,  user  input  must  be  clearly  communicated,  documented  and  used 
to  shape  the  program.  Adjustments  to  any  plan  are  inevitable  but  to  be  timely  and 
meaningful,  decisions  must  be  based  on  accurate  data.  This  approach  is 
tantamount  to  building  a  supportable  infrastructure  for  informed  decision-making. 

8.6  DEVELOP  AN  OVERARCHING  AMEDD  TELEMEDICINE  BUSINESS 
PLAN  FOR  REGION  6  BASED  ON  APPLICATION  OF  THE  AHP 
MODEL: 


The  AHP  model  based  business  plan  will  provide  Region  6  decision¬ 
makers  a  tool  on  which  to  develop  informed  judgements  for  both  short-term  and 
long-term  investments  in  advanced  technologies  and  the  adoption  of  commercial 
business  practices  for  the  region. 
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APPENDIX  A 


AHP  THEORY 


BASIC  THEORY  OF  THE  ANALYTIC  HIERARCHY  PROCESS' 


1.  Introduction 

When  one  speaks  of  relative  measurement,  those  of  us  trained  in  the  physical  sciences 
and  in  mathematics  are  likely  to  think  of  measuring  things.  For  example,  on  a  scale  such  as  the 
yard  or  the  meter,  each  with  its  units,  we  divide  the  corresponding  lengths  to  get  the  relative 
lengths.  But  that  is  not  what  I  mean  by  relative  measurement.  First  I  ask  what  should  I  do  if  I 
did  not  have  a  scale  to  measure  length  to  define  the  relative  length  of  two  objects? 

When  we  have  no  standard  scales  to  measure  things  absolutely,  we  must  make 
comparisons  and  derive  relative  measurements  from  them.  The  question  is  how,  and  what  we 
have  learned  in  this  process. 

We  should  note  that  we  are  not  talking  about  a  proposed  theory  that  we  can  accept  or 
reject.  Comparisons  leading  to  a  relative  measurement  is  a  talent  of  our  brains.  It  has  been 
neglected  in  science  because  we  have  not  learned  to  formalize  it  in  harmony  with  the  usual  way 
of  creating  standard  scales  and  comparing  things  one  at  a  time. 

The  cognitive  psychologist  Blumenthal1 2  writes: 

“Absolute  judgement  is  the  identification  of  the  magnitude  of  some  simple 
stimulus...,  whereas  comparative  judgement  is  the  identification  of  some  relation 
between  two  stimuli  both  present  to  the  observer.  Absolute  judgement  involves  the 
relation  between  a  single  stimulus  and  some  information  held  in  short-term  memory  - 
information  about  some  former  comparison  stimuli  or  about  some  previously  experienced 
measurement  scale  ...  To  make  the  judgement,  a  person  must  compare  an  immediate 
impression  with  impression  of  similar  stimuli. 

Thus  relative  measurement  through  comparative  judgement  is  intrinsic  to  our  thinking 
and  should  not  be  carried  by  as  an  appendage  whose  real  function  is  not  understood  well  or  at  all 
and  should  be  kept  outside.  It  is  not  difficult  to  see  that  relative  measurement  predates  and  is 
necessary  for  creating  and  understanding  absolute  measurement.  Some  of  the  work  reported  here 
is  now  well  know.  But  we  need  it  for  the  subsequent  discussion  that  lays  the  foundation  for 
relative  measurement. 


2.  The  Paradigm  Case;  Consistency 

We  will  first  show  that  when  the  judgements  used  measurements  from  a  scale  to  form  the 
ratios,  the  resulting  matrix  is  consistent  and  deriving  the  scale  is  an  elementary  but  fundamental 
operation.  Later  we  generalize  to  the  inconsistent  case  where  the  numerical  values  of  the 


1  Thomas  L.  Saaty,  Fundamentals  of  Decision  Making  and  Priority  Theory  with  the  Analytic  Hierarchy  Process, 
Volume  VI,  RWS  Publications,  Pittsburgh,  PA,  1995,  Chapter  2,  pp.  45-92 

2  Blumenthal,  A.L.,  1977,  The  Process  of  Cognition,  Prentice  Hall. 


judgements  are  not  taken  from  precise  measurements  but  are  ratios  estimated  according  to 
knowledge  and  perception. 

Let  us  assume  that  n  activities  are  being  considered  by  a  group  of  interested  people  and 
that  their  tasks  are 

a.  to  provide  judgements  on  the  relative  importance  of  these  activities,  and 

b.  to  ensure  that  the  judgements  are  quantified  to  an  extent  that  permits  a 
quantitative  interpretation  of  the  judgements  among  all  activities 

Our  goal  is  to  describe  a  method  for  deriving,  from  these  quantified  judgements  (i.e., 
from  the  relative  values  associated  with  pairs  of  activities),  a  set  of  weights  to  be  associated  with 
individual  activities  in  order  to  put  the  information  resulting  from  a  and  b  into  usable  form. 

Let  Al ,  A2 , . . . ,  An  be  the  activities.  The  quantified  judgements  on  pairs  of  activities 
(Aj,  A . )  are  represented  by  an  n-by-n  matrix 

A  =  (ai/),(i,j  =  l,2,...,n) 

The  problem  is  to  assign  to  the  n  activities,  Al,A2,...,An  a  set  of  numerical  weights 
w1,w2,...,w„  that  reflect  the  recorded  quantified  judgements. 

First  we  get  a  simple  question  out  of  the  way.  The  matrix  A  may  have  several,  or  a  few, 
non-zero  entries  a{j  Zeros  are  used  when  the  judgements  is  unavailable.  The  question  arise:  how 
many  entries  are  necessary  to  ensure  the  existence  of  a  set  of  weights  that  is  meaningful  in  the 
context  of  the  problem?  The  answer  is:  it  is  sufficient  that  there  be  a  set  of  entries  that 
interconnects  all  activities  in  the  sense  that  for  every  two  indices,  i,j,  there  should  be  some  chain 
of  (positive)  entries  connecting  i  with  j: 


Note  that  itself  is  such  a  chain  of  length  /.  (Such  a  matrix  A  =  (a, )  corresponds  to  a 
strongly  connected  graph.)  This  gives  precise  meaning  to  the  formulation  of  task  b. 

One  of  the  most  important  aspects  of  AHP  is  that  it  allows  us  to  measure  the  overall 
consistency  of  the  judgements  a,,  ■  An  extreme  example  of  inconsistent  judgement  is  if  we  judge 
one  activity  to  be  more  important  than  another  and  the  second  more  important  than  the  first, 
afj  >  1  and  ajt  >  1 .  More  subtle  is  the  case  when  the  judgements  of  the  three  alternatives  are 
not  “transitive.”  We  might  judge  one  stone  two  times  as  heavy  as  the  first,  a  third  stone  twice  as 
heavy  as  the  second,  but  the  first  and  last  to  be  of  equal  weights.  In  that  case  a;.  ^  ajkakj  .  This 
example  leads  us  to  the 

Definition-  A=(a,y)  is  consistent  if: 

aijajk  =  aik  where  i,  j,  k=  1,2,  ...  n 


We  see  that  such  a  matrix  can  be  constructed  from  a  set  of  n  elements  which  form  a  chain 
(or  more  generally,  a  spanning  tree,  a  connected  graph  without  cycles  that  include  all  n  elements 
its  vertices)  across  the  rows  and  columns. 

To  interpret  our  first  theorem  let  us  consider  the  following  case.  An  adult  and  a  child  are 
compared  according  to  their  height.  If  the  Adult  is  estimated  to  be  two  and  a  half  times  taller  that 
may  be  demonstrated  by  marking  off  several  heights  of  the  child  end  to  end.  However,  if  we 
have  an  absolute  scale  of  measurement  with  the  child  measuring  w,  units  and  the  adult  w2  units, 
then  the  comparison  would  assign  the  adult  the  relative  value  w2  /  w,  and  the  child  wl  /  w2  the 
reciprocal  value.  These  ratios  also  give  us  the  paired  comparison  values  /  w2)  / 1  and 
1  /  (w2  /  wl )  respectively,  in  which  the  height  of  the  child  serves  as  the  unit  of  comparison.  Such 
a  representation  is  valid  only  if  w]  and  w2  belongs  to  a  ratio  scale  so  that  the  ratio  w,  /  w2  is 
independent  of  the  unit  used,  be  it  in  inches  or  in  centimeters,  for  example.  In  this  way,  we  can 
interpret  all  ratios  as  absolute  numbers  or  dominance  units. 

Let  us  now  form  the  matrix  W  whose  rows  consist  of  the  ratios  of  the  measurements  w, 
of  each  n  items  with  respect  to  all  others. 


m 

/  w, 

wfw2  . 

..  wfwn 

i 

/  w, 

w2  /  w2  . 

..  W2lwn 

/  w, 

wjw2  . 

. 

. .  w  /  w 

n  n  \ 

It  is  easy  to  prove: 

Theorem  2.1  -  A  positive  nbyn  matrix  has  the  ratio  form  A  -  (wi  /  Wj),i,j  =  1  ,...n  if  and  only 
if  it  is  consistent. 

Corollary  If  2.1  is  true,  then  A  is  reciprocal. 

We  observe  that  if  W  is  the  matrix  above  and  w  is  the  vector  w  =  (w, ,  ...  wn)‘  then 
Ww  =  nw.  This  suggests 

Theorem  2.2  -  The  matrix  of  ratios  A  =  (w,  /  w  )  is  consistent  if  and  only  if  n  is  its  principal 
eigenvalue  and  Ww  =  nw.  Further  w>  0  is  unique  to  within  a  multiplicative  constant. 

Five  conditions  on  A  for  Preserving  Order 

A  weaker  condition  for  preservation  than 

(i)  (A)i>(A)/  implies  Wj>Wj 

is. 


(Ae)f  >  ( Ae)/  implies  Wj  >  Wj 


(ii) 


where  (A)l  >  (A)  f  denote  the  zth  row  and  y'th  row  sum  of  A,  and  its  generalization  to 
powers  of  A  given  in  the  normalized  form: 


(iii) 


(Ame)i^(Ame)/  . 

Ar — —  >  — — -  implies  W:>W; 
e‘Ame  e‘Ame  '  J 


The  condition  for  order  preservation  must  include  all  powers  of  A,  and  is  given  here  in 
terms  of  their  sum.  For  sufficiently  large  integer  N>0,  and  for  p>n 


(iv) 


ImPhesw.iwJ 


w=] 


and  by  (2): 


(v) 


1  '(Ame\.  v  1  '(Ame), 
lim-y  linr-y-T-rr 

P^> oo  p  e  A  e  p^xo  p  e  A  e 


implies  Wj  >  w. 


Theorem  2.3  If  A  is  consistent,  then 


p  e  A  e 
And  (i)  -  (v)  are  true 


3.  Small  Perturbations  and  Ratio  Scale  Approximation 

Because  we  are  interested  in  the  construction  of  an  appropriate  matrix  W  of  ratios  that 
serve  as  a  “good”  approximation  to  a  given  reciprocal  matrix  A,  we  begin  by  assuming  that  A 
itself  is  a  perturbation  of  W.  We  need  the  following  kind  of  background  information. 

For  an  unrepeated  eigenvalue  of  a  positive  matrix  A  it  Is  known3 4 5’4,5  that  a  small 
perturbation  A(s)  of  A  gives  rise  a  perturbation  X(s)  that  is  analytic  in  the  neighborhood  of  s  =  0 
and  small  because  A(e)  is  reciprocal.  The  following  theorems  give  us  a  part  of  what  we  need. 


3  Lancaster,  P.,  and  Miron  Tismenetsky,  1985,  “Linear  Transformations  and  Matrices,”  The  Theory  of  Matrices 
Second  Edition:  With  Applications,  Academic  Press,  Inc.,  Orlando 

4  Stewart,  G.  W.,  1973,  “Eigenvalues  and  Eigenvectors,”  Introduction  to  Matrix  Computations,  Academic  Press,  Inc. 
Orlando 

5  Wilkinson,  J.H.,  1965,  The  Algebraic  Eigenvalue  Problems,  Clarendon  Press,  Oxford 


Theorem  2.4  (Existence):  If  X  is  a  simple  eigenvalue  of  A,  then  for  small  s>  0,  there  is  an 
eigenvalue  X (s)  with  power  series  expansion  in  s: 

X(e)  =  X  +  £X(,)+e2X(2)  +  ••• 

And  corresponding  right  and  left  eigenvectors  00(e)  and  u(e)  such  that 

w(e)  =  w+£wm +e2w(2)  +  ■■■ 

u(s)  =  V  +  £Um  +  £2  V{2)  + 

Let  6t  be  a  perturbation  of  a  reciprocal  matrix  A  such  that  B  =  (afj  +  )  is  also 

positive6. 

Theorem  2.5  If  a  positive  reciprocal  matrix  A  has  the  eigenvalue  X ,,  X2,- ••  ,Xn  where  the 

n 

multiplicity  of  m  is  X ;  with  'Yjmi  =  n,  then  given  e  >  0  there  is  a  8(e)  >  0  such  that 

7=1 

if  |a(/  +  0j}  -  atj  j  <  8  for  all  i  and  j  the  matrix  B  has  exactly  mf  eignvalues  in  the  circle 

| JUj-Xj  <£  for  each j=l,2,...,s  where  pvp2,---,px  are  the  eigenvalues  of  B. 

If  A  is  a  consistent  matrix,  then  it  has  one  positive  eigenvalue  A,  =  n  and  all  other 
eigenvalues  are  zero.  For  a  suitable  £  >  0  there  is  a  8(e)  >  Qsuch  that  for  6f  |  <  e  the 
perturbed  matrix  B  has  one  eigenvalue  in  the  circle  | fl\  ~  n\  <  £  and  the  remaining 
eigenvalues  fall  in  a  circle  p  -0  <e  j=2,3,. . .,n. 

Theorem  2.6  Ifn  is  a  simple  eigenvalue  of  A  which  dominates  the  remaining  eigenvalues  in 
modulus,  for  sufficiently  small  e,  n(e)  =  Xm^  dominates  the  remaining  eigenvalues  of  A(e)  in 
modulus. 

When  A  is  inconsistent,  several  conditions  on  ait  and  on  wi  along  with  uniqueness,  must 
be  met  to  enable  us  to  approximate  A  by  ratios.  Our  conditions  are  divided  into  two 
categories.  One  category  deals  with  the  order  induced  by  as  absolute  numbers 
(w.  /  w  f  1 1  or  1  /  (Wj  /  Wj)  from  a  standard  scale,  on  the  components  of  the  scale  w.  The 
other  category  deals  with  the  equality  or  near  equality  of  the  atJ  to  the  ratio  (  wj  /  w  f 
formed  from  the  derived  scale  w. 

When  A  is  inconsistent,  how  do  we  construct  W  so  that  the  order  preservation  condition 
(v)  still  holds?  Later  we  address  the  other  question;  what  conditions  must  A  satisfy  to 
ensure  that  (w,  /  wf  is  a  “good”  approximation  to  a!l  ? 

Let  us  consider  estimates  of  ratios  given  by  an  expert  who  may  make  small  perturbations 


6  Franklin,  J.N.,  1968m  “Matrix  Theory,”  Prentice-Hall,  Englewood  Cliffs,  NJ. 


Ejj  in  W  =  (  w,  /  Wj ).  Comparisons  by  ratios  allow  us  to  write  atj  =  (w,  /  ,e,y  >  0 
i ,  j  =  1, 2, . . .,  n.  In  that  case,  A  takes  the  form  A  =  W  o  E  =  DED'1  where 
W  =  (w,  /  w i ),  E  =  (fji ) ,  D  a  diagonal  matrix  with  w  as  diagonal  vector  and  ‘o’  refers  to 
the  Hadamard  or  element  wise  product  of  the  two  matrices.  The  principal  eigenvalue  of 
A  coincides  with  that  of  E.  The  principal  eigenvector  of  A  is  the  element  wise  product  of 
the  principal  eigenvectors  w  =  ( w, ,  w2 , . . . ,  w„ ) T ,  and  e  =  ( 1 , . . . ,  1  )T  of  and  of  E 
respectively7. 

The  distinction  we  make  between  an  arbitrary  positive  matrix  and  a  reciprocal  matrix  is 
that  we  can  control  a  step  by  step  modification  of  a  reciprocal  matrix  so  that  in  the 
representation  A  =  WoE  =  DED'1,  the  i,  j  =  1,  2, ...,  n  are  small.  The  purpose  is  to 
ensure  that  the  perturbing  the  principal  eigenvalue  and  eigenvectors  of  W  yields  the 
principal  eigenvalue  and  eigenvector  of  A. 

Why  do  we  need  such  perturbations?  Because  we  assume  that  there  is  an  underlying 
ratio  scale  that  we  attempt  to  approximate.  By  improving  the  consistency  of  the  matrix, 
we  obtain  an  approximation  of  the  underlying  scale  by  the  principal  eigenvector  of  the 
resulting  matrix. 


Theorem  2.7  w  is  the  principal  eigenvector  of  a  positive  matrix  A  if,  and  only  if  Ee  =  /Lmaxe. 

Note  that  e  is  the  principal  eigenvector  of  E  and  E  is  a  perturbation  of  the  matrix  eTe. 
When  Ee  ■£  /Lmaxe  the  principal  eigenvector  of  A  is  another  vector  w'^w  and 
A  =  W'°E  where  Ee  =  Hmme. 

Corollary  w  is  the  principal  eigenvector  of  a  positive  reciprocal  matrix  A  =  W  o  E,  if 
and  only  if,  E  e  =  Anme  and  e/r  =  (ef )"' . 

Theorem  2.8  (order  preservation):  A  positive  matrix  A  satisfies  condition  (v),  if  and  only  if  the 
derived  scale  w  is  the  principal  eigenvector  of  A,  i.e.,  Aw  =  /Lmaxw. 

4.  Four  Conditions  for  Good  Approximations 

1)  Reciprocity 

The  reciprocal  condition  is  a  local  relationship  between  pairs  of  elements:  a  y  =  1  /  atj 
needed  to  ensure  that,  as  perturbations  of  ratios  a(J  and  a  jt  can  be  approximated  by 
ratios  from  a  ratio  scale  that  are  themselves  reciprocal.  It  is  a  necessary  condition  for 
consistency. 

2)  Homogeneity  -  Uniformly  Bounded  Above  and  Below 


7  Vargas,  L.  G.,  1983,  “Analysis  of  Sensitivity  of  Reciprocal  Matrices,”  Applied  Mathematics  and  Computation  12, 
pp.  301-320,  Elsevier  Science  Publishing  Co.,  Inc.,  New  York. 


Homogeneity  is  also  a  local  condition  on  each  af  To  ensure  consistency  in  paired 
comparisons,  the  elements  must  of  the  same  order  or  magnitude  which  means  that  our 
perceptions  in  comparing  them,  should  be  of  nearly  the  same  order  of  magnitude. 
Thus  we  require  that  the  be  uniformly  bounded  above  and  by  a  positive  constant  K 
and,  because  of  the  reciprocal  condition,  they  are  automatically  uniformly  bounded 
below  away  from  zero: 

1  /K<a(j<K,  K> 0,  i,j  =  l,2,...n 

It  is  a  fact  that  people  are  unable  to  directly  compare  widely  disparate  objects  such  as 
an  apple  and  a  watermelon  according  to  weight.  It  they  are  not  comparable,  it  should 
be  possible  to  aggregate  them  in  such  homogenous  clusters  to  make  the  comparisons. 
For  example,  we  put  the  apple  with  a  grapefruit  and  a  cantaloupe  in  one  cluster,  then 
the  cantaloupe  again,  a  honeydew  melon  and  varying  sizes  of  watermelons  in  another 
cluster.  The  relative  measurements  in  the  clusters  can  be  combined  because  we 
included  the  largest  element  (the  cantaloupe)  in  the  small  cluster  as  the  smallest 
element  of  the  adjacent  large  cluster.  Then  the  relative  weights  of  the  elements  in  the 
second  cluster  are  divided  by  the  relative  weights  of  the  common  element  and 
multiplied  by  its  relative  weight  in  the  smaller  cluster.  In  this  manner,  relative 
measurement  of  the  elements  in  the  two  clusters  can  be  related  and  the  two  clusters 
combined  after  obtaining  relative  measurement  by  paired  comparison  in  each  cluster. 
The  process  is  continued  from  cluster  to  adjacent  cluster. 

3)  Near  Consistency 

The  near  consistency  condition  is  global,  is  formed  in  terms  of  the  (structural 
parameters)  Tmax  of  n  and  of  A  and  W.  It  is  a  less  familiar  and  more  intricate 
condition  that  we  need  to  discuss  at  length.  The  requirement  that  comparisons  be 
carried  out  on  homogeneous  elements  ensure  that  the  coefficients  in  the  comparison 
matrix  are  not  too  large  and  generally  of  the  same  order  of  magnitude,  i.e.,  from  1  to 
9.  Knowing  this  constrains  the  size  of  the  perturbations  £,:/  ,  whose  sum  as  we  shall 
see  below,  is  measured  in  terms  of  the  near  consistency  condition  Amax  -  n. 

The  object  then  is  to  apply  this  condition  to  develop  algorithms  to  explore  changing 
the  judgements  and  their  approximation  by  successively  decreasing  the  inconsistency 
of  the  judgements  and  then  approximating  them  with  ratios  from  the  derived  scale. 
The  simplest  such  algorithm  is  one  which  identifies  that  for  which 
cijjW i  /  Wj  is  maximum  and  indicates  decreasing  it  in  the  direction  of  wi  /  wr 
Another  algorithm  due  to  Harker8  utilizes  the  gradient  of  the  ajr  In  the  end,  we  either 
obtain  a  consistent  matrix  or  a  closer  approximation  to  a  consistent  one  depending  on 
whether  the  information  available  allows  for  making  the  proposed  revisions  in  a,, . 

Because  consistency  is  necessary  and  sufficient  for  A  to  have  the  form 
A  =  {w}  /  wv),  we  use  w  to  explore  possible  changes  in  to  modify  A  “closer”  to  that 
form.  We  form  a  consistent  matrix  W'  =  (w)  /  w'j),  whose  elements  are 


8  Harker,  P.T.,  1987,  “Alternative  modes  of  questioning  in  the  analytic  hierarchy  process,”  Mathematical  Modeling 
9,  pp.  353-360 


approximations  to  the  corresponding  elements  of  A.  We  have  a;j  =  ( W  ,•  /  W[/)sv ,  etj  >  0 
We  have  the  converse  of:  given  a  problem  with  its  exact  solution,  use  the  properties 
of  this  solution  to  revise  the  problem,  i.e.  the  judgements  which  give  rise  to  at/ . 

Repeat  the  process  to  a  level  of  consistency,  (see  below). 


4)  Uniform  Continuity 


Uniform  continuity  implies  that  w,.,  i=\,2,...,n  as  a  function  of  ait  should  be 
relatively  sensitive  to  small  changes  in  the  a;j  in  order  that  the  ratios  wf  /  w  .  remain 
good  approximation  to  the  a(/ .  For  example,  it  holds  in  w,  as  the  fth  component  of 
the  principal  eigenvector  because  it  is  an  algebraic  function  of  Amm  (whose  value  is 
shown  to  lie  near  n  because  of  3),  and  of  the  afj  and  1  /  a- which  are  bounded. 

Let  us  now  turn  to  more  elaboration  of  the  near  consistency  condition  in  3).  We 
first  show  the  interesting  result,  that  inconsistency  or  violation  of  (1)  by  various  a:j 
can  be  captured  by  a  single  number  Amax  -  n  which  measures  the  deviation  for  all 
from  wt  /  Wj . 

Assume  that  the  reciprocal  condition  a ~  =  1  / ait  and  boundedness  ]  /  K< ajt  <  K 
where  K  >  0  is  a  constant,  hold.  Let  a{j  =  (1  +  Si:i )  wj  /  w t ,  <5>..  >  -1,  be  a  perturbation 
of  W=  (wj  /  where  w  is  the  principal  eigenvector  of  A. 

Theorem  2.9  Amax  >  n 


Using  a jj  =  1  /  atJ ,  and  Aw  =  w,  we  have 


=  -  2  - 

n  /</)  1 ' 


\<>i<  j<n  ^  3 jj 


>0 


Theorem  2.10  A  is  consistent,  if  and  only  if  =  n 


If  A  is  consistent,  then  because  of  (1),  each  row  of  A  is  a  constant  multiple  of  a  given 
row.  This  implies  that  the  rank  of  A  is  one,  and  all  but  one  of  its  eigenvalues 
A,.  =  1,2 ,...,«  are  zero,  However,  it  follows  from  our  earlier  argument  that 

n 

'YjAj  =  Trace(A)  =  n  .  Therefore  Tmax  =n.  Conversely  Amm  =  n  implies  £..  =  0  and 

<=i 

aij  =w,/wj. 

A  measure  of  inconsistency  is  obtained  by  taking  the  ratio  of  Amm  -  n  to  its  average 
value  over  a  large  number  of  reciprocal  matrices  of  the  same  order  n,  whose  entries  are 
randomly  chosen  in  the  interval [1/K,K].  If  this  ratio  is  small  (e.g.,  10%  or  less  -  for 
example  5%  for  3  by  3  matrices)9,  we  accept  the  estimate  of  w.  Otherwise,  we  attempt  to 
improve  consistency  and  derive  a  new  w.  After  each  iteration,  we  assume  that  the  new 


9  Golden,  B.L.  and  Q.  Wang,  1989,  “An  Alternate  Measure  of  Consistency:,  in  The  Analytical  Hierarchy  process  - 
Applications  and  Studies,  eds,  Golden,  Wasil  and  Harker,  Springer-Verlag,  New  York. 


matrix  is  a  perturbation  of  W  and  its  eigenvalue  and  eigenvector  are  perturbations  of  n 
and  w,  respectively. 

In  his  experimental  work  in  the  1950’s,  the  psychologist  George  Miller,  found  that  in 
general,  people  (such  as  chess  experts  looking  ahead  a  few  moves  to  decide  on  a  good 
next  move)  could  deal  with  information  involving  simultaneously  only  a  few  facts:  seven 
plus  or  minus  two.  With  more,  they  become  confused  and  cannot  handle  the  information. 
Since  the  individuals  needs  to  maintain  consistency  in  his  decision  matrix,  he  cannot 
consider  more  than  a  few  options  at  a  time.  This  is  in  harmony  with  the  established  fact 
that  for  a  reciprocal  matrix  (though  not  in  general)  the  eigenvalue  is  stable  for  small 
perturbations  when  n  is  small. 

We  have  seen  that  only  order  preserving  derived  scale  w  are  of  interest.  There  are  so 
many  ways  to  obtain  w  from  A.  Most  of  them  are  error  minimizing  procedures  such  as 
the  methods  of  least  squares: 


which  also  produces  nonunique  answers.  Only  the  principal  eigenvector  satisfies  order 
preserving  requirements  when  there  is  inconsistency.  We  summarize  with: 


Theorem  2.11  If  a  positive  n  by  n  matrix  A  is:  reciprocal,  homogeneous,  and  near  consistent, 
then  the  scale  w  derived  from  Aw  =  Tmaxw  is  order  preserving,  unique  to  within  a  similarity 
transformation  and  uniformly  continuous  in  the  a;/,  /,  /,=  1,2 

Similar  results  can  be  obtained  when  A  is  nonnegative.  Also  we  have  extended  this 
discrete  approximation  of  A  by  W  to  the  continuous  case  of  A  reciprocal  kernal  and  its 
eigenfunction10. 

4.  Structural  properties  of  Positive  Reciprocal  Matrices 

We  make  the  following  observations  on  the  structure  of  reciprocal  matrices.  The 
elementwise  product  of  two  n  by  n  reciprocal  matrices  is  a  reciprocal  matrix.  It  follows  that  the 
set  of  reciprocal  matrices  is  closed  under  the  operation  Hadamard  product.  The  matrix  eTe  is  the 
identity:  e  e=eTe  o  e  e  =  ee  and  A  is  the  inverse  of  A,  AoA  =A  oA=  e  e.  Thus  the  set  G  of  n 
by  n  reciprocal  matrices  is  an  abelian  group.  Because  every  subgroup  of  an  abelian  group  is 
normal,  in  particular,  the  set  of  n  by  n  consistent  matrices  is  a  normal  subgroup  (EoWoET=W)  or 
the  group  of  positive  reciprocal  matrices. 

Two  matrices  A  and  B  are  R-equivalent  (A  R  B)  if,  and  only  if,  there  are  a  vector  w  and 
positive  constant  a  and  b  such  that  (l/a)Aw=(l/b)Bw.  The  set  of  all  consistent  matrices  can  be 
partitioned  into  disjoint  equivalence  classes.  Given  a  consistent  matrix  W  and  a  perturbation 
matrix  E  such  that  Ee=ae,  a>0  a  constant,  we  use  the  Hadamard  product  to  define  A’=WoE  such 


10  L.  G.  Vargas,  1993,  “A  Model  of  Neural  Inpuslse  Firing  and  Synthesis”,  Journal  of  mathematical  Psychology  37, 
pp.  200-219. 


that  (l/a)A’W  =  (1/n)  Ww.  A’  and  W  are  equivalent.  There  is  a  1-1  correspondence  between 
the  set  of  all  consistent  matrices  and  the  set  of  all  matrices  A’  defined  by  such  Hadamard 
products.  An  equivalent  class  Q(W)  is  the  set  of  all  A’  such  that  A’R  W.  The  set  of  equivalence 
classes  Q(W)  forms  a  partition  of  the  set  of  reciprocal  matrices.  It  is  known  that  all  elements  in 
Q(W)  are  connected  by  perturbations  E,  E’,  E”, . . .,  corresponding  to  a  fixed  value  of  a  >  0  such 
that  (EoE’oE”..)e  =  ae.  Thus  given  an  arbitrary  reciprocal  matrix  A,  there  exists  an  equivalence 
class  to  which  A  belongs. 

DeTurk1 1  has  proved  that:  The  structure  group  G  of  the  set  of  positive  reciprocal  nxn 
matrices  has  2n\  connected  components.  It  consists  of  nonnegative  matrices  which  have  exactly 
one  nonzero  entry  in  each  zero  and  column.  These  matrices  can  be  written  as  D  •  S,  where  D  is 
a  diagonal  matrix  with  positive  diagonal  entries  and  S  is  a  permutation  matrix,  and  the  negatives 
of  such  matrices.  The  connected  component  G0  of  the  identity  consists  of  diagonal  matrices  with 
positive  entries  on  the  diagonal.  If  A  is  a  positive  diagonal  matrix  with  principal  right 
eigenvector  w-(w{,w2,...,wn)r  and  DSGU  is  a  diagonal  matrix  with  positive  diagonal  entries 
dl,d2,...,dn  then  I d( A)  =  DAD~'  is  a  positive  reciprocal  matrix  with  principal  eigenvector 
w  =  (d1wl,d2w2,..., dnwn)r .  The  principal  eigenvalue  is  the  same  for  both  matrices.  If 
w  =  {wl,w2,...,wn)‘  and  v,  /  w,,v2  /  w2,...,v;j  /  wn  are  two  positive  column  vectors,  then 
conjugation  by  the  diagonal  matrix  Dvw  with  entries  v  =  (v, ,  v2 , . . . ,  v„ ) 7  on  the  diagonal  maps  Aw 
onto  Av.  The  corresponding  diagonal  matrix  Dvw  provides  the  inverse  map.  Moreover,  Dwv  maps 
the  consistent  matrix  of  Aw  to  the  consistent  matrix  of  Av. 


5.  The  Hilbert  Metric 

There  are  many  ways  to  judge  when  two  ratio  scales  are  close.  But  there  is  one  that  is 
particularly  attractive  for  a  number  of  reasons.  The  theorem  of  Perron  says  that  if  A  is  a  positive 
linear  transformation  on  Rm,  then  there  is  an  x0  >  0  such  that  for  all  x0  >  0,  Anx  converges  in 
direction  to  so  that 


According  to  Birkhoff12,13,  this  theorem  is  a  special  case  of  the  contraction  mapping 
theorem  which  says  that  if  A  is  a  contraction  on  a  complete  metric  space  (X,D)  mapping  X  into 
X,  i.e.,  for  some  k  <1,  D(Ax,Ay)<kD(x,y )  for  all x,y  sX,  then  there  exits  xosX  such  that 
Anx  — »•  xn  for  all  x  sX. 

Birkhoff  observed  that  there  is  a  metric  D  on  x  which  all  positive  linear  transformations 
acting  on  the  set  of  rays  X  in  Rm+  satisfy  the  contraction  condition  because  convergence  in  rays 
is  also  convergence  in  direction.  The  unique  metric  D,  invented  by  Hilbert  for  non-Euclidean 


11  DeTurck,  D.M.,  1987,  “The  Approach  to  Consistency  in  The  Analytical  Hierarchy  Process,”  Mathematical 
Modelling  9/3-5,  pp.  345-352. 

12  Birkhoff,  G.,  1957m  “Extension  of  Jentzsch’s  Theorem”,  Trans,  Amer.  Math.  Soc.  85,  pp.  219-227. 

lj  Kohlberg,  E.,  and  John  W.  Pratt,  1982,  “The  Contraction  Mapping  Approach  to  the  perron-Frobenius  Theory: 
Why  Hilber;s  Metric?,”  Mathematics  of  Operations  Research  7/2. 


geometries  specialized  Rm+  that  marks  a  positive  (or  even  a  nonnegative)  matrix  to  a  contraction 
that  satisfies  the  theorem,  is  given  by: 


mln/  iXi  />',) 

Where  x  and  y  are  the  /th  coordinates  of  the  vectors  x  andy.  It  is  a  metric  on  rays  because 
D(ax,by)  =  D(x,y)  for  a,b  >  0  and  thus  it  is  order  preserving.  A  method  that  needs  to  preserve 
order  must  converge  along  rays  and  thus  cannot  use  an  arbitrary  metric. 

Hilbert’s  metric  is  useful  in  analyzing  closeness  when  ratio  scales  are  involved.  For 
example,  in  medical  diagnosis,  priorities  can  be  established  for  the  symptoms  of  one  of  several 
diseases.  An  arriving  patient  is  questioned  and  priorities  established  for  his  or  her  symptoms. 
This  vector  is  then  compared  with  each  of  the  priority  vectors  of  the  different  diseases  to 
determine  the  most  likely  illness  for  the  patient.  The  question  is,  what  is  a  reliable  way  for  it? 
The  Hilbert  metric  is  one  indicator  of  closeness.  So  is  the  Euclidean  metric.  My  colleague  Luis 
Vargas  and  I  have  performed  experiments  on  matrices  of  judgements  whose  entries  are  perturbed 
in  a  prescribed  range.  We  found  that  Hilbert’s  metric  is  useful  for  discrimination  among  vectors 
in  a  neighborhood  of  a  known  answer,  this  case  the  principal  eigenvector  of  the  original  matrix. 
The  ratios  in  the  Hilbert  metric  are  more  sensitive  to  small  variations  than  are  differences  in  the 
Euclidean  metric.  We  found  experimentally  that  both  metrics  taken  with  respect  to  a  given 
vector  follow  a  normal  and  log  normal  distribution  respectively.  These  distributions  can  then  be 
used  to  construct  stands  to  determine  if  a  given  point  fall  sin  a  range  close  to  the  given  vector. 
Multivariate  analysis  could  be  used  to  compare  the  results  of  both  metrics  as  to  whether  the 
points  falling  in  admissible  ranges  also  fall  in  the  n-dimensional  confidence  ellipsoid. 

6.  Concluding  Remarks 

Measurement  is  quantitative  information  useful  for  discriminating  among  magnitudes  and 
among  orders  of  magnitude.  Numerical  discrimination  is  different  than  cognitive  discrimination. 
Creativity  and  understanding  are  linked  to  our  cognitive  ability  and  are  not  to  our  ability  to  make 
precise  measurements.  It  is  rare  that  extreme  precision  is  needed  for  any  sort  of  understanding 
and  discrimination.  Even  in  science  measurement  and  precision  are  subject  to  interpretation.  It 
is  the  goal  s  we  pursue  that  need  to  be  served  and  we  are  in  control  of  the  importance  and 
meaningfulness  of  these  goals  as  they  serve  our  well  being  and  survival.  Precision  in  the 
preparation  of  drugs  is  necessary,  but  there  is  such  flexibility  that  the  same  size  pill  is  prescribed 
for  all  adults  regardless  of  the  size  of  their  bodies.  Precision  in  designing  the  gears  of  a  clock  is 
mandatory,  but  the  precision  in  time  is  one  and  only  one  aspect  of  experience  that  may  have  to 
be  traded  off  with  other  factors.  In  fact,  time  is  subjective  and  what  is  considered  is  good  in 
punctuality  by  some  may  be  regarded  as  some  kind  of  militancy  by  others.  Strict  punctuality  is  a 
human  normative  invention  not  respected  in  the  biology  of  cells  and  in  birth  and  death.  The 
question  si  whether  we  can  access  the  world  directly  and  satisfactorily  with  the  very  judgement 
we  use  to  evaluate  measurement. 


One  way  to  generate  measurement  on  different  orders  of  magnitude  is  to  use  the  senses  to 
make  distinctions  and  to  extend  their  use  to  lower  and  higher  magnitudes  through  instruments 
like  the  microscope  and  the  telescope.  The  size  of  objects  is  simple  one  of  a  very  large  number 
of  attributes  known  to  the  mind.  Not  all  magnitudes  have  the  capability  to  be  infinite  as  in  size 
and  weight,  length  and  time.  Most  properties  such  as  the  ability  to  love  and  the  ability  to  excel 
do  not  belong  to  the  sense  but  directly  to  the  mind.  The  mind  will  usually  bracket  their  extension 
in  one  or  in  a  few  orders  of  magnitudes.  Things  of  the  mind  must  often  be  defined  in  objects. 
Their  extension  may  be  theoretically  assumed  because  it  cannot  be  seen  with  the  eyes,  felt  with 
the  hands  or  experienced  with  the  body.  In  principal  if  there  were  no  people,  there  may  not  exist 
such  properties.  In  fact,  these  attributes  could  determine  why  we  assign  significance  to 
properties  in  the  real  world. 


APPENDIX  B 


PROJECT  EVALUATION  AND  SELECTION  MODELS 


PROJECT  EVALUATION  AND  SELECTION1 

Evaluation  and  Selection  Models:  Basic  Types 


There  are  basically  two  types  of  selection  models,  numeric  (quantitative)  and  nonnumeric 
(qualitative).  Nonnumeric  models  are  older  and  simpler  and  have  a  few  subtypes  to  examine. 
Selecting  the  type  of  project  evaluation  depends  on  the  philosophy  and  wishes  of  management. 
The  weighted  models  are  favored  for  three  fundamental  reasons.  First,  they  allow  multiple 
objectives  of  all  organizations  to  be  reflected  in  the  important  decisions  about  which  projects  will 
be  supported  and  rejected.  Second,  scoring  models  are  easily  adapted  to  change  in  managerial 
philosophy  or  changes  in  the  environment.  Third,  they  do  not  suffer  the  bias  towards  the  short 
run  that  is  inherent  in  profitability  models  that  discount  future  cash  flows. 

The  structure  of  weighted  scoring  models  is  quite  straightforward.  Its  virtues  are  may. 
Nevertheless,  the  actual  use  of  scoring  models  is  not  as  easy  as  it  might  seem.  Decision-makers 
are  forced  to  make  difficult  choices  and  they  are  not  always  comfortable  doing  so.  They  are 
forced  to  reduce  often  vague  feelings  to  quite  specific  words  or  numbers.  Multicriteria  and 
multiperson  decision  making  is  not  simple. 

The  types  of  models  discussed  in  this  appendix  includes: 

NONNUMERIC  MODELS 

-  Sacred  Cow 
Operating  Necessity 

-  Competitive  Necessity 

-  Product  Line  Extension 
Comparative  Benefit  Model 

NUMERIC  MODELS:  PROFITABILITY 
Payback  Period 

-  Average  Rate  of  Return 

-  Discounted  Cash  Flow 
Internal  Rate  of  Return 
Profitability  Index 
Other  Profitability  Models 

OTHER  MODELS:  OPERATIONS  RESEARCH  &  ECONOMICS  (Mentioned  in  the 

main  report) 

Cost  Benefit  Analysis 
Operations  Research  Models 
Weighted  Explicit  Linear  Models 
Equally  weighted  Explicit  Linear  Models 


NUMERIC  MODELS:  SCORING 

-  Unweighted  0-1  Factor  Scoring 

-  Unweighted  Factor  Scoring 

-  Weighted  Factor  Scoring 

-  Constrained  Weighted  Factor 
Scoring 


1 J.  Meredith,  S.  Mantel,  Jr.  “Project  Management:  A  Managerial  Approach,  3rd  Edition,  John  Wiley  &  Sons,  Inc. 
pp.  47-79. 


NONNUMERIC  MODELS  -  Although  it  is  easy  to  dismiss  the  nonnumeric  models  as 
unscientific,  they  should  not  be  discounted  casually.  These  models  are  clearly  goal-oriented  and 
directly  reflect  the  concerns  of  the  organization. 

•  SACRED  COW  -  The  project  is  suggested  by  a  senior  and  power  official  in  the 
organization.  Often  the  project  is  initiated  by  a  simple  comment  such  as,  “If  you  have 
the  chance,  why  don’t  you  look  into  . . .,”  and  there  follows  and  undeveloped  idea  for 
a  new  project,  for  the  development  of  a  new  market,  for  the  installation  of  a  new 
information  system,  and  for  some  other  project  requiring  an  investment  of  the 
organization’s  resources.  The  immediate  result  of  this  bland  statement  is  the 
creation  of  a  “project”  to  investigate  whatever  the  boss  has  suggested.  The  project  is 
“sacred”  in  the  sense  that  it  will  be  maintained  until  the  successfully  concluded,  or 
until  the  boss,  personally,  recognizes  the  idea  as  a  failure  and  terminates  it. 

•  OPERATING  NECESSITY  -  If  a  flood  is  threatening  the  plant,  a  project  to  build  a 
protective  dike  does  not  require  much  formal  evaluation.  If  a  project  is  required  in 
order  to  keep  a  system  operating,  the  primary  question  becomes:  Is  the  system  worth 
saving  at  the  estimated  cost  of  the  project?  If  the  answer  is  yes,  the  project  costs  will 
be  examined  to  make  sure  that  they  are  kept  as  low  as  is  consistent  with  project 
success,  but  the  project  will  be  funded. 

•  COMPETITIVE  NECESSITY  -  The  decision  to  undertake  a  project  is  based  on  the 
desire  to  maintain  competitive  position  in  the  market  place.  Investments  in  operating 
necessity  takes  precedence  over  competitive  necessity.,  both  types  of  projects  may 
bypass  the  more  careful  numeric  analysis  used  for  projects  deemed  to  be  less  urgent 
or  less  important  to  the  survival  of  the  organization. 

•  PRODUCT  LINE  EXTENSION  -  A  product  to  develop  and  distribute  new  products 
would  be  judged  on  the  degree  to  which  it  fits  the  firm’s  existing  product  line,  fills  a 
gap,  strengthens  a  weak  link,  or  extends  a  line  in  a  new,  desirable  direction. 
Sometimes  careful  calculations  of  profitability  are  not  required.  Decision-makers  can 
act  on  their  beliefs  about  what  will  be  the  likely  impact  on  the  total  system 
performance  if  the  new  product  is  added  to  the  line. 

•  COMPARATIVE  BENEFIT  MODEL  -  Assume  that  an  organization  has  many 
projects  to  consider.  Senior  management  would  like  to  select  a  subset  of  the  projects 
that  would  be  most  benefit  to  the  firm,  but  the  project  do  not  seem  to  be  easily 
comparable.  The  concept  of  comparative  benefits,  if  not  a  formal  model,  is  widely 
used  for  selection  decision  on  all  sorts  of  projects.  The  projects  are  evaluated 
according  to  the  evaluator’s  recommendations. 

Of  the  several  techniques  for  ordering  projects,  the  Q-Sort2.  Firs,  the  projects  are 
divided  into  three  groups  -  good,  fair,  and  poor  according  to  their  relative  merits.  If 

2  Henlin,  A.  F.,  and  W.  E.  Souder,  “Experimental  Test  of  a  Q-Sort  Procedure  for  prioritizing  R&D  Projects”,  IEEE 
Transactions  on  Engineering  Management,  NOV  1974. 


any  group  has  more  than  eight  members,  it  is  subdivided  into  two  categories,  such  as 
fair-plus,  and  fair-minus.  When  all  the  categories  have  eight  or  less  members, 
projects  within  each  category  are  ordered  again  from  best  to  worst.  Again,  the  order 
is  determined  on  the  basis  of  relative  merit.  The  rater  may  use  specific  criteria  to 
rank  each  project  or  may  simply  use  general  overall  judgement. 

The  evaluation  process  may  be  carried  out  by  one  person  who  is  responsible  for 
evaluation  and  selection  or  by  a  committee.  In  a  committee  evaluation,  it  is  common 
for  such  ranking  to  differ  from  rater  to  rater,  but  they  do  not  often  vary  strikingly 
because  the  raters  rarely  differ  widely  on  what  they  feel  to  be  appropriate  for  the 
parent  organization. 


NUMERIC  MODELS:  PROFITABILITY  -  Majority  of  organizations  using  project  evaluation 
and  selection  models  use  profit/profitability  as  the  sole  source  of  measure  of  acceptability 

•  PAYBACK  PERIOD  -  The  payback  period  for  a  project  is  the  initial  fixed 
investment  in  the  project  divided  by  the  estimated  annual  cash  inflows  from  the 
project.  The  ratio  of  these  quantities  is  the  number  of  years  required  for  the  project  to 
repay  its  initial  fixed  investment.  This  method  assumes  that  the  cash  inflows  will 
persist  at  least  long  enough  to  pay  back  the  investment,  ignores  any  cash  inflows 
beyond  the  payback  period.  The  method  also  serves  as  an  inadequate  proxy  for  risk. 
The  faster  the  investment  is  recovered,  the  less  the  risk  to  which  the  organization  is 
exposed. 

•  AVERAGE  RATE  OF  RETURN  -  Often  mistaken  as  the  reciprocal  of  the  payback 
period,  the  average  rate  of  return  is  the  ratio  of  the  average  annual  profit  (either 
before  or  after  taxes)  to  the  initial  or  average  investment  in  the  project.  Because  the 
average  annual  profits  are  not  equivalent  to  net  cash  inflows,  the  average  rate  of 
return  does  not  equal  the  reciprocal  of  the  payback  period. 

•  DISCOUNTED  CASH  FLOW  -  Also  referred  to  as  the  present  value  method,  the 
discounted  cash  flow  method  determines  the  net  present  value  of  all  cash  flows  by 
discounting  them  by  the  required  rate  of  return  (also  know  as  the  hurdle  rate,  cutoff, 
rate,  and  similar  terms)  as  follows, 


n 

NPV(project)  =  A0  +  ^ 
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Where 


F,  =  the  net  cash  flow  in  the  period  t, 
k  =  the  required  rate  of  return,  and 
A0  =  initial  cash  investment 


To  include  the  impact  of  inflation  (or  deflation)  where  pt  is  the  predicted  rate  of 
inflation  during  the  period  /,  we  have 
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INTERNAL  RATE  OF  RETURN  -  If  we  have  a  set  of  expected  cash  inflows  and 
cash  outflows,  the  internal  rate  of  return  is  the  discount  rate  that  equates  to  the  present 
value  of  the  two  set  of  flows.  If  At  is  an  expected  cash  outflow  in  the  period  t  and  Rt  is 
the  expected  inflow  for  the  period  t,  the  internal  rate  of  return  is  the  value  k  that 
satisfies  the  following  equation. 
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PROFITABILITY  INDEX  -  Also  known  as  the  benefit-cost  ratio,  the  profitability 
index  is  the  net  present  value  of  all  future  expected  cash  flows  divided  by  the  initial 
cash  investment. 


OTHER  PROFITABILITY  MODELS  -  There  are  a  great  man  variations  of  other 
profitability  models.  These  variations  fall  into  three  general  categories: 

(1 )  those  that  subdivide  net  cash  flow  into  the  elements  that  comprise 
the  net  flow, 

(2)  those  that  include  specific  terms  to  introduce  risk  (or  uncertainty, 
which  is  treated  as  risk)  into  the  evaluation, 

(3)  those  that  extend  the  analysis  to  consider  effects  that  the  project 
might  have  on  other  projects  or  activities  in  the  organization 

Comments  on  profit-profitability  numeric  models  include: 

ADVANTAGES 

1 .  The  undiscounted  models  are  simple  to  use  and  understand. 

2.  All  use  readily  available  accounting  data  to  determine  cash  flows. 

3.  Model  output  is  in  terms  familiar  to  decision  makers. 

4.  With  a  few  exceptions,  model  output  is  on  an  “absolute”  profit/profitability  scale 
and  allows  “absolute”  go/no-go  decisions. 

5.  Some  profit  models  account  for  project  risk. 


DISADVANTAGES 


1 .  These  models  ignore  all  nonmonetary  factors  except  risk. 

2.  Models  that  do  not  include  discounting  ignore  the  timing  of  the  cash  flows  and  the 
time  value  of  money. 

3.  Models  that  reduce  cash  flows  to  their  present  value  are  strongly  biased  towards 
the  short  run. 

4.  Payback-type  models  ignore  cash  flows  beyond  the  payback  period. 

5.  The  Internal  Rate  of  Return  model  can  result  in  multiple  solutions. 

6.  All  are  sensitive  to  errors  in  the  input  data  for  the  early  years  of  the  project. 

7.  All  discounting  models  are  nonlinear,  and  the  effects  of  changes  (or  errors)  in  the 
variable  parameters  are  generally  not  obvious  to  most  decision  makers. 

8.  Those  models  incorporating  the  risk  of  research  and  development  and/or  process 
(the  commercial  success  risk  factor  is  excluded  from  this  comment)  mislead  the 
decision  maker.  It  is  not  so  much  that  the  research-development-process  success 
is  risky  as  it  is  that  the  time  and  cost  required  to  ensure  project  success  is 
uncertain.  The  application  of  these  risk  terms  applies  mainly  to  R  &  D  projects. 

9.  Some  models  are  oriented  only  towards  evaluation  of  projects  that  result  in  new 
projects. 

10.  All  these  models  depend  for  input  on  a  determination  of  cash  flows,  but  it  is  not 
clear  how  the  concept  of  cash  flow  is  properly  defined  for  the  purpose  of 
evaluating  projects. 


NUMERIC  MODELS:  SCORING 


•  UNWEIGHTED  0-1  FACTOR-  A  set  of  relevant  factors  is  selected  by  management. 
These  are  usually  listed  in  preprinted  form,  and  one  or  more  raters  score  the  project 
on  each  factor  depending  on  whether  or  to  it  qualifies  for  that  individual  criterion. 
The  raters  are  chosen  by  senior  management  for  the  most  part  from  the  rolls  of  senior 
management.  The  criteria  for  choice  are  a  clear  understanding  of  the  organizational 
goals  and  a  good  knowledge  of  the  firm’s  project  portfolio. 

The  main  advantage  of  such  a  model  is  that  it  uses  several  criteria  in  the  decision 
process.  The  major  disadvantages  are  that  it  assumes  all  criteria  are  of  equal 
importance  and  allows  for  no  gradation  of  the  degree  to  which  a  specific  project 
meets  the  various  criteria. 

•  UNWEIGHTED  FACTOR  -  The  second  disadvantage  of  the  0-1  factor  model  can  be 
dealt  with  by  constructing  a  simple  linear  measure  of  the  degree  to  which  the  project 
being  evaluated  meets  each  of  the  criteria  contained  on  the  list.  For  example,  using 
the  criteria  “estimated  profits  in  dollars”,  a  sample  unweighted  factor  scoring  scale 
may  be  constructed. 


SCORE 

PERFORMANCE  LEVEL 

5 

Above  $1,000,000.00 

4 

$750,000.00  to  $999,999.99 

3 

$500,000.00  to  $749,999.99 

2 

$200,000.00  to  $499,999.99 

1 

Less  than  $200,000.00 

Table  1  Sample  Scoring  using  the  Unweighted  Factor  scoring  Model 


WEIGHTED  FACTOR  SCORING  MODEL  -  When  numeric  weights  reflecting  the 
relative  importance  of  each  individual  factor  are  added,  we  have  a  weighted  factor 
scoring  model.  In  general,  it  takes  the  form 

si=1Lsiwi  J  =  1-2, 3. ..,n 

7=1 

where 

Si  =  tlie  total  score  of  the  z'th  project 

Sy  -  the  score  of  the  zth  project  on  the  /th  criterion,  and 

Wj  =  the  weight  of  the  /th  criterion 

The  weights,  Wj,  may  be  generated  by  any  technique  that  is  acceptable  to  the 
organization’s  policy  makers.  The  weight  of  each  criterion  can  be  interpreted  as  the 
“percentage  of  the  weight  according  to  that  particular  criterion.” 

A  special  caveat  is  in  order.  It  is  quite  possible  with  this  type  of  model  to  include 
a  large  number  of  criteria.  It  is  not  particularly  difficult  to  develop  scoring  scales  and 
weights,  and  the  ease  of  gathering  and  processing  the  required  information  makes  it 
tempting  to  include  marginally  relevant  criteria  along  with  the  obviously  important 
item.  Resist  this  temptation!  After  the  important  factors  have  been  weighted,  there 
usually  is  little  residual  weight  to  be  distributed  among  the  remaining  elements.  The 
result  is  that  the  evaluation  is  simply  insensitive  to  major  differences  in  the  score  on 
trivial  criteria.  A  good  rule  of  thumb  is  to  discard  elements  with  weights  less  than 
0.02  or  0.03.  (As  with  any  linear  model,  the  users  should  be  aware  that  the  elements 
in  the  model  are  assumed  to  be  independent.  This  presents  no  particular  problem  for 
the  scoring  models  because  they  are  used  to  make  estimates  in  “steady  state’  systems, 
and  are  not  concerned  with  transitions  between  states. 

CONSTRAINED  WEIGHTED  FACTOR  SCORING  MODEL  -  The  temptation  to 
include  marginal  criteria  can  be  partially  overcome  by  allowing  additional  criteria  to 
enter  the  model  as  constraints  rather  than  weighted  factors.  These  constraints 
represent  project  characteristics  that  must  be  present  or  absent  in  order  for  the  project 
to  be  acceptable.  We  would  amend  the  weighted  scoring  model  to  take  the  form: 


s> = Z  wTIc* 

./-I  k=\ 

where  c\\=\  if  the  z'th  project  satisfies  the  Mr  of  v  constraints,  and  0 
if  it  does  not. 

Again,  a  caveat  is  in  order.  Exercise  care  when  adopting  constraints.  It  may  seem 
obvious  that  we  should  not  consider  any  project  if  it  has  no  reasonable  assurance  of 
long-run  profitability.  But  such  a  constraint  force  us  to  overlook  a  project  that, 
although  unprofitable  itself,  might  have  a  strong,  positive  impact  on  the  profitability 
of  other  projects  in  which  we  are  interested. 


OTHER  MODELS:  FROM  OPERATIONS  RESEARCH  AND  ECONOMICS 

•  Cost  Benefit  Analysis 

•  Operations  Research  Models 

•  Explicit  Linear  Models 
•  Weighted 


Equally  weighted 
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NUMERIC  SCALES 


NUMERIC  SCALES 


The  misuse  of  numbers  is  one  reason  that  numerical  analyses  are  sometimes  flawed. 
Unfortunately,  some  decision  models  based  on  flawed  numerical  reasoning  may  go  undetected, 
leaving  the  decision  makers  left  wondering  why  the  results  do  not  make  sense.  Therefore,  a  brief 
review  of  what  is  know  as  the  levels  of  measurement  using  Stevens’  classification  scheme1,2,3 
are  discussed  in  detail. 

1 .  Nominal  -  Nominal  numbers,  the  lowest  level  in  terms  of  meaning  conveyed,  are 
just  numerical  representation  for  names.  Nominal  numbers  are  used  for  identification 
purposes  only  and  imply  nothing  about  ordering.  Telephone  numbers  and  social  security 
numbers  are  ordinal.  Are  you  ‘older’  or  ‘better’  than  someone  else  because  your 
telephone  number  is  higher?  Obviously  not,  and  people  rarely  make  mistakes  with 
nominal  numbers. 

2.  Ordinal  -  Ordinal  number  implies  an  order  or  ranking  among  elements.  The  order 
may  be  either  increasing  or  decreasing  depending  on  application.  A  ranking  implies  an 
ordering  among  elements  but  nothing  more.  It  does  not  imply  anything  about  the 
differences  or  interval  between  items.  For  example,  if  we  know  only  that  a  professional 
baseball  team  finished  in  second  place  at  the  end  of  the  season,  we  do  not  know  if  the 
team  was  one  game  behind  the  first  place  team  or  twenty  games  behind.  Care  must  be 
taken  to  not  add  or  multiply  ordinal  number.  Errors  arising  from  the  addition  of  ordinal 
data  are  too  common. 

3.  Interval  -  Interval  scale  data  possess  the  meaning  of  Nominal  and  Ordinal  data,  as 
well  as  having  meaning  about  the  interval  between  objects.  Corresponding  intervals  on 
different  parts  of  an  interval  scale  have  the  same  meaning.  If  we  have  interval  level  data 
then  we  can  infer  that  the  interval  between  two  objects  with  values  of  20  and  5  (an 
interval  of  1 5)  is  equivalent  to  the  interval  between  two  objects  with  values  of  80  and  65. 
Interval  level  data  can  be  use  din  arithmetic  operations  such  as  addition  and 
multiplication.  However,  after  adding  interval  level  data,  one  can  not  infer  that  a  total  of 
100  is  twice  as  good  as  a  total  of  50.  If  one  were  to  allocate  resources  based  on  this 
inference,  then  the  allocation  would  be  incorrect. 

4.  Ratio  -  Ratio  level  data  (sometimes  called  ratio  scale)  is  the  highest  level,  having 
Nominal,  Ordinal,  and  Interval  properties,  as  well  as  the  property  of  ratios. 

Corresponding  ratios  on  different  parts  of  a  ratio  scale  have  the  same  meaning.  If  we 
have  a  ratio  scale  data,  then  the  ratios  between  two  objects  with  values  of  1 00  and  50  is 
equivalent  to  the  ratios  of  two  objects  with  values  of  6  and  3.  A  ratio  scale  is  often 
defined  as  one  having  a  true  zero  point.  For  our  purposes,  it  is  easier  to  think  of  a  ratio 


1  S.  S.  Stevens,  “On  the  Theory  of  Scales  of  measurement”,  Science  (103,  1946),  pp.  677-680. 

2  F.  S.  Roberts,  Measurement  Theory  with  Applications  to  decision-making,  Utility  and  the  Social  Science,  (London, 
Addison  Wesley,  1979). 

3  J.  C.  Vansnick,  “Measurement  Theory  and  Decision  Aid”,  Proceedings  of  the  Third  International  Summer  School 
on  Multiple  Criteria  Decision  Methods,  Applications  and  Software,  (Monte  Estoril,  Portugal:  July  1988). 


scale  as  one  for  which  equivalent  ratios  are  considered  equal.  Temperature  on  the 
Fahrenheit  scale  is  not  a  ratio  measure.  However,  temperatures  on  the  Kelvin  scale, 
which  has  ratio  property,  such  inferences  would  be  correct. 


For  mathematical  operations,  the  nominal,  ordinal,  interval,  and  ratio  scales  have  additional 
meaning: 

•  Addition/subtraction  and  multiplication/division  require  at  least  interval  level 
meaning 

•  An  interval  level  number  can  be  multiplied  by  a  constant  or  a  ratio  level  number 
but  cannot  be  multiplied  by  another  interval  level  number 

•  There  are  no  restriction  when  using  ratio  level  numbers 
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Chapter  6 

Evaluation  of  Group  Decision  Making  Methods 


6.1  Introduction 

In  this  chapter  we  are  concerned  with  the  evaluation  of  different  methods  of  group  decision-making  on 
a  wide  set  of  criteria  which  range  from  the  strictly  technical,  to  the  psychophysical  and  social,  and 
finally,  to  the  logical  and  scientifically  valid.  Our  purpose  is  to  identify  similarities  and  differences 
with  the  aim  of  showing  from  such  wide  consideration  which  method  is  more  reliable,  and  is  likely  to 
gain  greater  attention  both  in  academia  and  in  practice.  This  writer  is  not  an  inexperienced  (and 
completely  unbiased)  observer  as  I  have  familiarized  myself  with,  have  applied  several  of  these 
methods,  and  have  developed  opinions  and  preference  about  them.  It  will  be  seen  below  that  the  AHP 
is  the  most  comprehensive  of  these  methods  in  structure,  in  analysis,  in  mathematical  validity,  and  in 
its  producing  truthful  results.  Its  outcome  would  survive  outside  influences  because  it  is  able  to 
incorporate  such  influences  in  its  hierarchies,  and  assess  their  relative  impact  on  the  outcome  in  a  way 
that  does  not  tax  one's  intelligence  to  accept  its  procedures,  nor  do  these  procedures  alienate  the  user. 
The  Analytic  Network  Process  (ANP)  is  a  natural  generalization  and  extension  of  the  AHP  that  allows 
feedback  and  dependence  among  decision  elements  and  clusters  of  elements  [Saaty,  1996] .  The  fact 
that  numerous  examples  of  applications  of  the  ANP  exist  shows  that  the  AHP  can  be  generalized,  and 
is  thus  a  validation  of  the  AHP  itself,  as  generalizability  is  a  necessary  condition  for  a  good  decision 
theory. 

There  are  criteria  proposed  in  the  literature  to  judge  group  decision  making.  We  use  these  criteria  as  a 
basis  to  establish  new  criteria  forjudging  group  decision  support  methods.  We  identify  and  briefly 
describe  most  of  the  known  methods  in  decision-making.  We  define  various  intensity  measures  on 
each  of  the  new  criteria.  We  evaluate  each  of  these  methods  by  assigning  it  the  intensity  that  describes 
it  best  on  each  criterion,  explaining  briefly  why  that  intensity  is  appropriate  for  the  method.  In  this 
manner,  the  methods  are  compared  and  contrasted  with  respect  to  each  criterion,  and  an  AHP  model 
is  developed  to  obtain  an  overall  rating  of  the  methods. 


6.2  Criteria  for  Group  Decision  Making  Methods 

Rubin  [Swap  and  associates,  1984]  proposed  six  quality  indicators  for  group  decision  making  that 
address  both  achievement  and  maintenance  goals  [Brightman;  1980,  1988):  efficiency,  careful 
development  and  analysis  of  alternatives,  fairness,  member  satisfaction  and  morale,  leadership 
effectiveness,  and  growth  over  time.  These  indicators  are  developed  from  a  group  process  point  of 
view,  and  need  to  be  translated  into  another  set  of  indicators  before  they  can  be  used  as  criteria  for 
evaluating  the  methodologies  that  facilitate  for  a  group  to  excell  on  those  quality  indicators.  We 
exclude  efficiency  from  our  analysis  because  it  is  highly  dependent  on  the  way  the  group  is  organized 
and  lead.  However,  we  will  later  outline  how  the  AHP  facilitates  efficient  group  decision  making 
without  making  an  attempt  to  compare  or  contrast  it  with  the  other  methods.  We  perceive  growth  over 
time  as  learning.  We  assume  that  a  method  which  addresses  group  maintenance  (leadership 
effectiveness  and  learning)  will  also  ensure  member  satisfaction  and  morale,  hence  we  do  not  consider 
the  latter  as  a  criterion  explicitly. 

First  of  all,  a  general  method  for  group  decision  making  must  provide  a  facilitator  with  the  means  to 
lead  the  group  toward  its  achievement  and  maintenance  goals.  The  method  must  also  assist  the 
facilitator  in  enhancing  individual  and  group  learning,  both  single  loop  or  small  "1"  learning  and 
double  loop  or  big  "L"  learning  [Argyris,  1977,  1994;  Pascale,  1991].  It  addresses  the  first  if  it 
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enables  the  group  to  solve  problems  of  implementing  organizational  policies  and  achieving  the  goals 
of  the  organization  through  incrementally,  based  on  past  performance  and  knowledge.  It  addresses  the 
second  if  it  facilitates  questioning  the  underlying  assumptions  of  those  policies  and  goals  through 
breakthrough  shift  of  knowledge.  Careful  development  of  alternatives  means  that  the  group  must  not 
view  a  problem  from  a  scope  too  narrow  to  ensure  a  meaningful  solution  or  too  broad  to  ensure 
controllable  actions.  It  also  means  that  the  group  must  be  able  to  identify  a  set  of  distinct  alternatives 
from  a  level  of  abstraction  that  is  adequate  for  the  group.  For  example,  a  group  of  top  executives 
would  view  a  problem  from  a  higher  level  of  abstraction  than  would  a  group  of  operational  managers 
because  they  have  a  much  wider  choice  space  from  which  to  draw  controllable  alternative  courses  of 
actions.  Careful  analysis  of  alternatives  requires  the  group  to  work  with  a  model/structure 
[Reagan-Cirincione,  1994]  with  the  appropriate  breadth  (for  relevance)  and  depth  (for  precision).  A 
successful  analysis  depends  on  faithfulness  of  judgment  elicitation,  psychophysical  applicability,  and 
the  depth  of  the  analysis.  One  must  first  accept  the  premise  that  eliciting  judgment  by  comparing  two 
objects  with  respect  to  a  certain  property  would  produce  the  most  faithful  representation  of  one's  tacit 
preference  relations.  Faithful  judgment  can  be  obtained  if:  (1)  it  is  expressed  directly  by  the  decision 
maker,  rather  than  derived  from  some  other  form  of  judgments,  (2)  it  is  not  clear  to  the  decision 
maker  as  to  how  that  particular  judgment  would  ultimately  affect  the  outcome  and  hence  would  not 
play  games  with  it  to  influence  the  outcome,  thus  preventing  strategic  judgment  [Dummett,  1984], 
and  (3)  the  decision  maker  has  the  choice  to  express  preference  relations  numerically  (as  a  minimum 
for  representing  objective  measurement)  or  verbally  (for  representing  perception  or  feeling),  or  even 
graphically.  Depth  of  analysis  means  how  well  an  analytical  method  provides  the  means  to  guide 
decision  makers'  thinking  to  ensure  the  validity  of  the  outcome.  It  includes,  for  example,  having  a 
feedback  mechanism  for  making  changes  and  adjustments  or  directing  the  decision-maker  to  an  expert 
or  looking  for  specific  information. 

Fairness  is  addressed  both  during  group  interaction,  and  when  the  diverse  information  or  judgments 
from  individuals  must  be  mathematically  aggregated  into  one  judgment  for  the  group.  On  this 
criterion,  we  are  only  concerned  with  the  method  of  aggregation,  since  group  discussion  would  be 
controlled  by  the  facilitator.  A  strong  condition  for  a  successful  decision  theory  is  that  it  needs  to 
result  in  the  alternatives  being  cardinally  separated  rather  than  simply  ordered.  The  group  members 
themselves  may  need  to  be  prioritized  as  to  the  reliability  of  their  opinions.  Other  actors  or 
stakeholders  who  may  be  affected  by  the  implementation  of  the  decision  often  need  to  be  considered, 
and  a  successful  method  needs  to  have  a  way  to  include  their  judgments. 

Most  significantly,  a  method  must  be  applicable,  valid,  and  reflect  the  truth.  One  would  be  concerned 
with  such  issues  as:  (1)  is  the  method  applicable  to  conflict  resolution,  (2)  does  it  apply  to  intangibles 
in  the  same  way  it  does  to  tangibles,  (3)  does  it  have  mathematical  validity  and  generality,  and  is  it 
supported  with  axioms  and  theorems,  (4)  can  the  method  be  applied  to  psychophysical  measurement, 
and  (5)  is  the  outcome  valid,  ensuring,  for  example,  reliability  in  prediction. 

Applicability  to  conflict  resolution  means  the  method  must  provide  a  way  for  each  conflicting  party  to 
evaluate  the  costs  and  the  benefits  of  giving  up  some  of  what  it  has,  in  return  for  getting  what  it  wants 
from  the  other  party.  Applicability  to  intangibles  involves  inclusion,  and  measurement  of,  the 
multidimensionality  of  the  factors  involved.  Mathematical  validity  and  generality  calls  for  formal 
mathematical  representation  of  the  logic  and  reasoning  behind  a  theory  and  the  economy  of  additional 
assumptions  required  for  its  generalization.  Psychophysical  applicability  means  that  an  analytical 
method  must  deal  with  the  measurement  of  relationships  between  the  physical  attributes  of  stimuli  and 
the  resulting  sensation  reflecting  diminishing  response  to  increasing  stimulus  such  as,  for  example, 
that  described  by  the  Weber-Fechner  law.  Validity  of  the  outcome  involves  the  accuracy  of  the 
outcome  in  predicting  situations.  One  should  be  careful,  however,  to  define  what  constitutes  a 
prediction  situation.  In  an  experimental  study,  Schoemaker  and  Waid  [1982]  showed  that  guesswork 
direct  estimation  of  the  rank  of  multicriteria  objects  produces  a  very  different  ordinal  ranking  from 
that  of  the  AHP. 

The  following  criteria  are  used  to  compare  and  contrast  the  various  methods: 
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1.  Group  maintenance:  leadership  effectiveness. 

We  assume  that  all  group  methods  enhance  leadership  effectiveness.  We  use  a  democratic  leader's 
characteristics  as  criteria  for  leadership  effectiveness,  assuming  that  the  group  mostly  works  in 
moderate  situational  control  in  terms  of  leader-member  relations,  task  clarification,  and  position 
power  [Lewin,  Lippit,  and  White,  1939;  Fiedler,  1973].  A  method  is  rated  low  if  it  is  highly  technical 
or  does  not  involve  much  interaction  and  where  leadership  is  of  a  little  concern,  medium  if  it  provides 
no  more  than  structure  to  facilitate  group  leadership,  and  high  if  it  also  provides  other  collaborative 
tools  and  the  necessary  control  mechanism  to  guide  the  facilitator's  leadership  actions  in  pursuing  the 
group's  achievement  and  maintenance  goals. 


2.  Group  maintenance:  learning 

It  is  assumed  that  objective  knowledge,  widely  accepted  and  agreed  upon  knowledge,  is  considered 
less  important  by  the  people  involved  in  the  group  than  what  they  know  from  their  experience 
relevant  to  the  issues  and  what  they  learn  by  problem  solving  within  the  group.  A  method  is  rated  low 
if  it  advances  technical  learning  that  has  little  to  do  with  the  group  member's  subjective  values, 
medium  if  it  improves  understanding  with  regard  to  cause-effect  relations  in  a  problem  (but  actions 
may  not  be  clear,  single  loop  or  small  T  learning  only,  or,  it  does  not  provide  clear  evaluation  of 
alternatives),  high  if  it  facilitates  both  single  and  double  loop  learning,  or  small  "1"  and  big  "L" 
learning  (leading  to  action),  and  very  high  if  it  also  enables  one  to  produce  the  necessary  material  to 
facilitate  learning  beyond  the  membership  of  the  group. 


3.  Problem  abstraction:  scope 

The  need  for  problem  abstraction  or  definition  is  inherent  in  any  decision  making,  therefore  this 
indicator  is  assumed  to  be  addressed  by  all  methods.  The  question  is  whether  a  method  explicitly 
addresses  this  issue  or  not.  Voting  is  an  exception  for  which  alternatives  are  always  given,  hence 
problem  abstraction  is  not  applicable  and  this  method  is  rated  NA.  A  method  is  rated  low  if  it  does  not 
propose  a  specific  technique  and  does  not  involve  problem  analysis  that  enhances  the  scope  of 
abstraction,  medium  if  its  technique  creates  boundaries  that  limit  group  thinking,  or,  if  it  does  not 
propose  a  specific  technique  but  involves  problem  analysis  that  serves  as  feedback  to  broaden  problem 
abstraction,  and  high  if  double  loop  learning  is  explicitly  addressed. 


4.  Problem  abstraction:  development  of  alternatives. 

It  is  generally  assumed  that  the  alternatives  are  not  given  to  the  group,  hence  any  method  involving 
problem  structuring  must  go  through  a  process  of  identifying  alternatives.  It  is  assumed  that 
multicriteria  methods  require  a  process  of  generating  alternatives  that  allows  a  certain  degree  of 
interaction  among  group  members.  It  is  also  assumed  that  a  method  for  enhancing  problem  abstraction 
leads  to  a  set  of  alternatives.  Again,  voting  is  an  exception  because  a  set  of  alternatives  is  always 
given.  A  method  is  rated  NA  if  the  alternatives  must  be  given,  low  if  it  does  not  provide  a  specific 
technique  for  identifying  alternatives,  medium  if  it  ensures  a  free  wheeling  environment  without  group 
interaction,  or,  if  it  generates  incremental  alternatives  (it  is  assumed  that  innovative  change  is  more 
preferred  to  incremental  change),  high  if  it  ensures  a  free  wheeling  environment  as  well  as  group 
interaction  but  no  requirement  that  the  alternatives  selected  satisfy  certain  properties  or  requirements 
(e.g.,  distinct  or  independent),  very  high  if  it  is  also  based  on  challenged  assumptions,  if  it 
systematically  generates  alternatives,  or,  if  it  requires  the  alternatives  to  satisfy  certain  properties  to 
ensure  the  validity  of  the  outcome. 
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5.  Structure:  breadth 

A  structure  is  said  to  be  broad  if  it  has  many  distinct  elements  (criteria)  that  are  assumed  to  be 
independent  of  each  other.  A  problem  that  is  modelled  by  more  than  one  such  structure  is  considered 
to  be  even  broader.  A  method  is  ranked  NA  (not  applicable)  if  it  does  not  involve  problem  structuring, 
low  if  the  method  allows  only  one  element  (direct  comparison),  medium  if  the  method  creates  a 
constraint  with  respect  to  the  number  of  elements,  and  high  if  there  is  no  such  constraint. 


6.  Structure:  depth 

A  structure  is  said  to  be  deep  if  each  element  is  broken  down  into  sub-elements,  each  sub-element  into 
sub-sub-elements  and  so  on  down  to  the  most  detailed  elements.  A  method  is  ranked  NA  if  it  does  not 
involve  structuring,  low  if  it  allows  only  one  element,  medium  if  it  creates  a  constraint  with  respect  to 
the  number  of  elements,  and  high  if  there  is  no  such  constraint. 


7.  Analysis:  faithfulness  of  judgments 

A  method  is  rated  NA  if  it  does  not  involve  problem  analysis,  low  if  it  does  not  include  intensity  of 
preferences,  medium  if  it  involves  direct  assignment  of  numbers  to  represent  intensity  on  an 
unvalidated  scale,  high  if  it  is  derived  from  some  other  judgments  carefully  elicited,  very  high  if  it  is 
elicited  in  the  most  elementary  way  (pairwise  comparison  with  respect  to  a  property),  expressed  in  a 
way  that  fits  the  decision  maker  best  (numerically,  verbally,  or  graphically),  or,  if  it  is  by  design  an 
objective  method,  or,  if  it  is  continuously  improved. 


8.  Analysis:  breadth  and  depth  of  analysis  (what  if) 

A  method  is  rated  NA  if  it  does  not  involve  problem  analysis,  low  if  it  allows  judgment,  but  not 
analysis,  medium  if  the  depth  of  analysis  is  constrained  by  the  method's  structure,  high  if  it  provides 
the  means  for  careful  thinking  (but  it  is  difficult  to  review  previous  analysis),  and  very  high  if  it 
facilitates  careful  thinking  and  review. 


9.  Fairness:  cardinal  separation  of  alternatives 

This  indicator  is  applicable  only  to  methods  that  involve  aggregation  of  judgments  of  individual 
members.  Alternatives  can  only  be  treated  either  fairly  (high)  or  not  fairly  (low).  A  method  is 
evaluated  according  to  its  consistency  with  the  impossibility  problem  intrinsic  in  ordinal  group 
aggregation.  An  aggregation  method  is  rated  low  if  it  uses  an  ordinal  scale  of  measurement  and  high  if 
it  uses  an  interval  or  a  "ratio  scale.  A  method  is  rated  NA  if  it  does  not  involve  judgment  aggregation. 


10.  Fairness:  prioritizing  of  group  members 

This  indicator  is  also  applicable  only  to  methods  that  involve  aggregation  of  individual  judgments. 
Voting  theories  usually  operationalize  fairness  as  equal  treatment  of  the  voters.  In  group  decision 
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making,  there  may  be  circumstances  in  which  the  group  may  want  to  apply  the  concept  of  fairness 
with  unequal  treatment  of  the  individuals  involved.  For  example,  weights  may  need  to  be  assigned  to 
the  members  according  to  the  relevance  of  their  expertise  or  to  their  known  previous  contribution  to 
the  goal.  A  method  is  rated  NA  if  it  does  not  involve  judgment  aggregation,  low  if  individual 
preferences  are  represented  on  an  ordinal  scale,  medium  if  the  preferences  are  represented  on  an 
interval  or  ratio  scale  (but  the  individuals  must  carry  the  same  weight),  high  if  it  also  provides  a 
group  with  an  option  to  treat  group  members  unequally  (but  the  weights  are  assigned  arbitrarily),  and 
very  high  if  it  provides  a  method  to  determine  the  weights  as  appropriately  as  the  group  wishes. 


11.  Fairness:  consideration  of  other  actors  and  stakeholders 

This  criterion  is  applicable  only  to  methods  that  involve  problem  analysis.  A  method  is  rated  NA  if  it 
does  not  involve  problem  analysis,  low  if  addressing  fairness  to  other  actors  which  might  be  possible 
(but  it  is  not  yet  made  explicit  in  the  method),  medium  if  it  addresses  the  issue  explicitly  but 
qualitatively,  and  high  if  it  addresses  the  issue  both  explicitly  and  quantitatively. 


12.  Scientific  and  mathematical  generality 

A  method  is  rated  NA  if  it  does  not  involve  problem  analysis,  low  if  it  does  not  involve  any 
mathematics,  medium  if  it  involves  mathematics  that  is  not  axiomatized,  or,  it  involves 
multidimensional  concepts  that  may  be  axiomatized  differently  by  different  researchers  leading  to  a 
diversity  of  theorems,  high  if  it  is  axiomatized  with  more  or  less  unified  conceptualization  (but  its 
generalization  has  considerable  mathematical  rigor),  and  very  high  if  its  theorems  are  axiomatized  and 
generalizable  in  a  natural  and  less  taxing  way  by  not  requiring  many  new  assumptions. 


13.  Applicability  to  tangibles 

A  method  is  rated  NA  if  it  does  not  involve  problem  analysis,  low  if  it  does  not  involve  quantification 
of  intangibles,  or,  simply  assigns  arbitrary  ordinal  numbers  to  intangibles,  medium  if  it  involves 
measuring  intangibles  on  an  interval  or  a  ratio  scale  (but  must  be  represented  by  tangibles  or 
intensities  in  absolute  terms  with  no  assigned  priority,  high  if  it  involves  measuring  intangibles  on  an 
interval  or  a  ratio  scale,  but  must  be  represented  by  tangibles  or  intensities  in  absolute  terms  with 
assigned  priority),  and  very  high  if  its  measurement  is  applicable  to  intangibles  and  gives  an 
assessment  of  their  relative  importance,  both  absolutely  or  relatively,  as  the  user  wishes. 


14.  Psychophysical  applicability 

A  method  is  rated  NA  if  it  does  not  involve  problem  analysis,  low  if  it  does  not  address  the 
Weber-Fechner  law,  medium  if  it  could  but  requires  a  complex  model  that  may  not  be  practical  to 
develop  or  to  apply,  and  high  if  it  is  psychophysically  applicable. 


15.  Applicability  to  conflict  resolution 

A  method  must  have  a  theory  and  perhaps  also  normative  standards  for  best  solution  of  a  group 
conflict  that  is  understandable,  acceptable,  practical,  flexible,  and  has  been  demonstrated  to  work  well 
in  practice.  Such  a  method  would  be  rated  high.  However,  secrecy  makes  it  hard  to  use  such  an 
approach  in  a  clear  step  by  step  fashion,  and  hence  people  often  resort  to  less  structured  and  less 
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explicit  methods.  For  this  reason,  an  analytical  method  for  dealing  with  conflict  resolution  is  rated 
medium. 


16.  Validity  of  the  outcome  (prediction) 

A  method  is  rated  NA  if  it  does  not  involve  problem  analysis,  low  if  it  uses  ordinal  measurement  with 
no  structural  representation  of  a  problem,  medium  if  it  uses  cardinal  measurement,  but  its  main 
concern  is  computation,  or,  if  it  uses  ordinal  measurement  with  some  problem  representation,  or,  if  it 
provides  a  rigorous  model  without  measurement,  high  if  it  uses  cardinal  measurement,  but 
mathematical  validity  sets  limits  on  the  structural  representation  of  a  problem,  and  very  high  if  it  uses 
cardinal  measurement  and  no  theoretical  limit  with  respect  to  the  structural  representation  of  the 
problem. 


6,3  Group  Decision  Making  Methods 

The  methods,  other  than  the  AHP  described  in  earlier  chapters,  are  outlined  to  highlight  the  points  of 
interest  for  our  evaluation.  Couger  [1995]  provides  a  summary  of  most  of  the  methods. 


6.3.1  Structuring 

Analogy  and  attribute  association  are  methods  for  gaining  fresh  prespectives  on  a  problem  to  create 
an  alternative  space  from  which  meaningful  and  controllable  distinct  alternatives  are  likely  to  be 
identified.  They  involve  the  use  of  key  words  from  the  original  formulation  of  a  problem  as  the  means 
to  identify  relations  between  the  otherwise  unrelated  analogy/association  and  the  original  problem. 

Boundary  examination  is  a  conscious  effort  to  openly  challenge  and  restructure  the  underlying 
assumptions  that  prevent  one  from  seeing  a  problem  from  a  broad  perspective.  The  progressive 
abstraction  method  increases  problem  abstraction  implied  in  the  goal  step  by  step.  This,  along  with 
the  first,  differ  in  technique  but  their  purpose  is  so  similar  that  we  do  not  consider  them  as  different 
methods. 

Brainstorming  [Osborne,  1957]  is  based  on  the  premise  that  deferred  judgments  enhance  creativity 
and  that  oral  communication  diminishes  it.  Its  modification  includes,  e.g.,  brainwriting  (generating 
ideas  in  writing),  bug  list  and  negative  brainstorming  (generating  complaints  to  identify  weaknesses), 
the  Crawford  blue  slip  method  (independently  brainstorms  in  response  to  a  number  of  questions  that 
are  related  to  a  problem),  and  discussion  among  group  participants  as  long  as  it  is  not  judgmental. 

Morphological  connection  is  an  attempt  to  broaden  the  space  of  alternatives  not  through  problem 
abstraction,  but  from  different  combinations  of  problem  attributes  as  in  a  hierarchy.  Despite  what  the 
term  may  imply,  this  method  is  not  designed  for  connecting  or  structuring  different  ideas  related  to  a 
problem  to  make  a  decision. 

Why -What's  Stopping  is  proposed  for  formulating  ill-structured  problems  [Basadur,  Ellspermann,  and 
Evans;  1994].  It  consists  of  a  series  of  diverging  and  converging  ideas  by  seeking  responses  to  the 
questions:  "How  might  we..."  (to  elicit  ideas  on  alternative  solutions)  "What's  stopping  us  ..."  (to 
provide  narrower  subproblems  for  each  response  to  the  "How  might  we..."  query),  and  "Why  would 
we  need  to  ..."  (to  ensure  that  we  work  on  the  right  problem  as  stated  in  the  "How  might  we. . . " 
query).  The  outcome  of  this  process  is  a  big  picture  of  a  problem,  indicating  relationships  among 
problems  and  sub-problems,  to  help  decision  makers  select  the  most  meaningful  problem  area  to  work 
on. 
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6.3.2  Ordering  and  Ranking 

Voting,  as  has  been  discussed  at  length  in  the  previous  chapters,  elicits  ordinal  judgments  and 
mathematically  aggregates  them  into  a  group  judgment.  It  is  considered  as  a  single  criterion  analysis 
since  the  individuals  compare  alternatives  directly.  For  our  purpose,  interaction  among  members  is 
considered  irrelevant. 

The  Nominal  Group  Technique  (NGT)  [Delbecq,  Van  de  Ven,  and  Gustafson;  1975]  takes  advantage 
of  the  positive  aspects  of  brainstorming  and  brainwriting  and  structured  communication  that  improves 
alignment  of  group  members'  perception  of  the  problem  without  working  towards  concensus. 

The  Delphi  method  [Turoff,  1970;  Linstone  and  Turoff,  1975;  Gustafson,  Shukla,  Delbecq,  and 
Walster,  1973]  is  similar  to  NGT  except  that  the  group  members  do  not  meet  face  to  face.  A  great 
deal  of  preparation  is  required  due  to  the  nature  of  written  communication. 

Disjointed  incrementalism  is  a  method  to  select  the  best  policy  based  on  its  incremental  consequences. 
This  method  was  proposed  to  deal  with  complex  policy  decisions,  typically  in  the  government,  in 
which  a  holistic  approach  for  policy  decisions  is  either  impossible  or  impractical.  It  has  been  argued 
that  muddling  through  is  a  science. 

Matrix  evaluations  refer  to  methods  for  presenting  information  to  facilitate  the  evaluation  of 
alternatives.  It  may  describe  factors  and  subfactors  involved  in  a  problem  with  their  ranking  scores, 
or  by  providing  the  relative  overall  positions  of  alternatives  in  a  multidimensional  space.  For 
example,  various  company  products  may  be  evaluated  with  respect  to  their  market  share  and  growth 
(BCG  matrix)  or  various  organizational  improvement  with  respect  to  their  importance  and  imminence 
[Camillus  and  Datta,  1991].  These  methods,  however,  do  not  provide  a  methodological  way  to  arrive 
at  a  decision. 

Goal  programming  is  an  approach  to  optimize  a  set  of  objective  functions  subject  to  constraints. 
However,  it  does  not  necessarily  suggest  decisions  that  optimize  the  objective  functions  [Ching  and 
Ming;  1987].  It  only  yields  decisions  that  "satisfice"  [Simon,  1957].  The  outcome  is  perceived  as 
indicating  trade  offs  that  need  to  be  made  in  terms  of  reducing  a  certain  objective  in  return  for  an 
increase  in  some  other  objectives. 

Conjoint  measurement  is  concerned  with  predicting  the  values  of  a  dependent  variable  by  combining  a 
set  of  independent  variables  in  some  functional  form.  The  coefficients  of  the  function  are  usually 
estimated  by  regression  techniques.  A  conjoint  analysis  measure  has  been  suggested  for  use  as  a 
numerical  basis  for  estimating  the  priorities  of  a  goal  programming  problem  [O'Leary  and  O'Leary, 
1985]. 

The  concept  of  outranking  was  developed  by  B.  Roy  based  on  Multiattribute  Utility  Theory  (MAUT) 
principles  with  the  motivation  to  improve  efficiency  without  affecting  the  outcome  while  considering 
less  information.  The  idea  is  to  see  whether  there  are  enough  arguments  to  decide  that  an  alternative 
A i  is  at  least  as  good  as  Aj,  while  there  is  no  essential  reason  to  refute  that  statement.  Researchers  in 

this  area  have  worked  toward  the  satisfactory  axiomatization  of  the  concept,  in  which  criterion 
prioritization  has  been  their  major  preoccupation  [Roy  and  Bouyssau,  1985;  Vincke,  1989],  In  the 
meantime,  ten  different  methods  have  been  developed  to  apply  the  concept.  They  differ  in  how  the 
reason  is  formalized  that  leads  to  refuting  the  statement  that  is  at  least  as  good  as  Aj,  the  type  of 

decision  problem  (choice,  scoring,  or  ranking)  they  address,  the  preference  model  they  adopt 
(whether  or  not  Weber-Fechner's  psychophysical  law  is  to  be  embraced),  whether  or  not  the  concept 
of  probability  is  used,  and  the  way  criteria  weights  are  determined.  A  main  weakness  of  the  method  is 
the  ordinal  way  used  to  combine  concordance  and  discordance  that  leaves  one  in  doubt  about  the 
accuracy  of  its  outcome. 
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6.3.3  Structuring  and  Measuring 

Bayesian  analysis  is  a  popular  statistical  decision  making  process  which  provides  a  paradigm  for 
updating  information  in  the  form  of  probabilities.  It  is  based  on  the  premise  that  decisions  involving 
uncertainty  can  only  be  made  with  the  aid  of  information  about  the  uncertain  environment  in  which 
the  decision  is  made.  Bayesian  theory  updates  information  by  using  Bayes  theorem,  a  statement  in 
conditional  probabilities  relating  causes  (states  of  nature)  to  outcomes.  Outcomes  are  results  of 
experiments  used  to  uncover  the  causes.  Bayesian  theory  revises  initial  or  prior  probabilities  of 
causes,  known  from  a  large  sample  of  a  population,  into  posterior  probabilities  by  using  the  outcome 
of  an  experiment  or  test  with  a  certain  probability  of  success.  Prior  probabilities  are  obtained  either 
subjectively  or  empirically  by  sampling  the  frequency  of  occurence  of  a  cause  in  a  population. 
Posterior  probabilities  are  those  based  on  the  prior  probabilities  and  on  both  the  outcome  of  the 
experiment  and  on  the  observed  reliability  of  that  experiment.  Bayesian  analysis  often  makes  heavy 
use  of  probability  trees  and  that  is  why  we  have  included  in  this  section. 

Multiattribute  Utility  (Value j  Theory  (MAUT/MAVT)  [Luce  and  Raiffa,  1957]  attempts  to  maximize  a 
decision  maker's  utility  (under  uncertainty)  or  value  (preference)  which  is  represented  by  a  function 
that  maps  an  object  measured  on  an  absolute  scale  into  the  decision  maker's  utility  or  value  relations. 
The  function  is  constructed  by,  for  example  in  the  case  of  MAUT,  asking  lottery  questions  involving 
probability  to  articulate  decision  makers'  value  trade-offs  among  the  conflicting  attributes.  Preferences 
are  used  in  MAYT.  The  functional  representation  of  a  multicriteria  problem  is  obtained  by 
aggregating  the  different  single  attribute  functions,  each  representing  a  different  attribute,  by  taking 
into  consideration  the  relative  weights  of  the  attributes.  The  use  of  objective  measurement  leads  to  a 
complex  functional  representation  if  the  Weber-Fechner  law  is  to  be  embraced.  The  law  suggests  that 
the  relation  between  a  stimulus  and  an  individual's  response  is  not  as  smooth  as  may  be  indicated  by  a 
continuous  utility  function.  Maintaining  that  "it  is  now  firmly  established  that  expected  utility  (EU) 
theory  and  subjective  expected  utility  (SEU)  theory  are  descriptively  invalid,"  Miyamoto  [1992] 
proposes  a  generic  utility  theory,  designed  as  a  general  framework  for  descriptive  multiattribute  utility 
modelling.  A  group  utility  or  value  function  that  takes  the  diversified  evaluations  of  its  individual 
members  into  consideration,  can  be  obtained  either  by  aggregating  individual  functions  or  by  partial 
identification  of  the  group  function  [Seo,  1985].  Game  theory,  which  is  based  on  utility  theory,  has 
been  used  to  study  conflict  resolution.  Recent  versions  of  MAUT/MAVT  have  tended  to  look  at  the 
broad  complexity  of  a  problem  within  a  structured  framework  and  not  simply  as  criteria  and 
alternatives. 


6.4  Evaluation  of  the  Methods  on  the  Criteria 


1.  Group  maintenance:  leadership  effectiveness 

Analogy /association,  brainstorming,  morphological  connection,  voting,  goal  programming,  and 
conjoint  analysis  are  rated  low  because  the  methods  are  highly  technical.  Boundary  examination, 
why -what's  stopping,  NGT,  Delphi,  disjointed  incrementalism,  matrix  evaluation,  outranking, 
Bayesian  analysis,  and  MAUT/MAVT  are  rated  medium  because  they  provide  nothing  more  than 
simple  structures  to  assist  a  facilitator.  AHP  is  rated  high  because  it  provides  collaborative  tools  to 
enhance  communication  effectiveness,  inconsistency  and  incompatibility  measures  that  provide 
feedback  to  the  group  members  to  ensure  validity  of  the  outcome,  structure  to  facilitate  task  division, 
and  the  means  to  balance  consensus  and  voting  to  obtain  group  judgments. 


2.  Group  maintenance:  learning 
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Brainstorming,  voting,  goal  programming,  and  conjoint  analysis  are  rated  low  because  they  involve 
highly  technical  knowledge.  Brainstorming  excludes  member  interaction  because  of  its  requirement 
that  there  be  no  discussion  or  criticism  of  ideas  proposed.  Analogy /association,  boundary 
examination,  morphological  connection,  why -what's  stopping,  NGT,  Delphi,  and  matrix  evaluation 
are  rated  medium  because  they  improve  understanding  of  the  problem,  but  actions  to  take  from  them 
may  not  be  readily  clear.  Disjointed  incrementalism,  outranking,  Bayes  analysis,  MAUT/MAVT  are 
rated  high  because  it  is  assumed  that  their  outcomes  provide  learning  that  leads  to  action.  Research 
indicates,  however,  that  despite  group  satisfaction,  study  participants  rated  the  combination  of  NGT 
and  MAUT  as  low  in  improving  knowledge  about  the  content  of  the  issue  [Thomas,  McDaniel,  and 
Dooris;  1989].  AHP  is  rated  very  high  because  it  provides  a  highly  summarized  description  of  the 
problem  that  facilitates  learning  beyond  membership  of  the  group.  Participants  in  an  experimental 
study  ranked  the  AHP  as  the  least  difficult  and  the  most  trustworthy  method  among  those  studied 
[Schoemaker  and  Waid.,  1982].  It  is  assumed  that  the  easier  to  apply  and  the  more  trustworthy  a 
method  is,  the  more  one  learns  from  its  application. 


3.  Problem  Abstraction:  Scope 

Voting  is  rated  NA  because  a  group  does  not  generally  generate  alternatives,  and  thus  broaden  the 
scope,  but  is  somehow  given  a  set  of  alternatives.  Brainstorming  does  not  involve  a  specific  technique 
to  enhance  problem  abstraction  and  does  not  involve  problem  analysis,  and  so  it  is  rated  low.  The  use 
of  key  words  from  the  original  formulation  of  a  problem  in  analogy  and  attribute  association,  which 
ensures  some  relations  between  the  analogy  or  association  problem  with  the  original  problem,  at  the 
same  time  sets  perceptual  boundaries.  For  example,  an  analogy  to  a  difficulty  is  usually  another 
difficulty  (as  opposed  to  an  opportunity)  and  a  spatial  problem  is  likely  to  generate  attributes  that 
direct  thinking  to  increasing  the  productivity  of  the  space  given  the  same  demand,  rather  than 
reducing  the  demand  itself.  For  this  reason,  these  methods  are  ranked  medium.  Nominal  Group 
Technique  and  Delphi  are  also  rated  medium  because  they  include  careful  preparation  of  a 
questionnaire  for  the  group  to  respond  to  which  implies  the  development  of  problem  abstraction. 
Disjointed  incrementalism,  matrix  evaluation,  goal  programming,  conjoint  analysis,  outranking, 
Bayes,  MAUT/MAVT,  and  AHP  do  not  involve  a  technique  to  broaden  problem  abstraction,  but  since 
analysis  enhances  problem  abstraction,  they  are  rated  medium.  Also  outranking,  Bayes, 

MAUT/MAVT,  and  AHP  are  rated  medium  because  they  are  assumed  to  apply  techniques  such  as  NGT 
or  Delphi  which  are  rated  medium.  Morphological  analysis  is  rated  high  because  of  its  systematic 
search  for  combinations  of  attributes  that  produce  candidates  for  alternatives.  'Why -what's  stopping  is 
also  rated  high  because  its  why 's  questions  uncover  the  assumptions  underlying  the  difficulties  in 
implementing  the  suggested  solutions  identified  by  the  what's  (how's)  questions.  Structuring  the 
responses  to  the  repeated  questions  provides  highly  comprehensive  relationships  among  problems, 
subproblems,  and  alternative  courses  of  action.  Boundary  examination  systematically  challenges  the 
underlying  assumptions  regarding  the  problem,  hence  it  is  also  rated  high. 

4.  Problem  abstraction:  development  of  alternatives 

Analogy  and  attribute  association,  boundary  examination,  matrix  evaluation,  goal  programming, 
conjoint  analysis,  and  Bayes  analysis  are  rated  low  because  identifying  alternatives  is  not  an  explicit 
part  of  the  method.  Brainstorming /brainwriting  is  rated  medium  because  it  ensures  a  free-wheeling 
environment  but  does  nothing  to  take  advantage  of  the  positive  aspects  of  interaction  among  group 
members.  This  method  assumes  that  an  alternative  ranked  high  by  the  group  is  the  most  relevant 
solution  to  the  problem,  which  may  not  be  generally  true  because  the  group  does  not  get  to  bring  out 
possible  disadvantages  to  the  suggested  alternatives.  This  weakness  is  inherent  in  brainstorming  as 
well  as  in  its  modifications,  e.g.,  brainwriting  (generating  ideas  in  writing),  bug  list  and  negative 
brainstorming  (generating  complaints  to  identify  weaknesses).  Crawford's  blue  slip  method 
(independently  brainstorming  in  response  to  a  number  of  questions  that  are  related  to  a  problem)  does 
not  tell  one  how  to  organize  the  information.  Brainstorming  addresses  the  negative  aspect  of 
communication  by  removing  interaction  from  the  decision  process,  at  the  cost  of  taking  advantage  of 
its  positive  aspects.  This  may  be  the  reason  why  this  popular  method  is  observed  as  the  least  effective 
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technique  [Couger,  1995].  Disjointed  incrementalism  is  also  rated  medium ,  but  because  it  generates 
incremental  alternatives  rather  than  distinct  ones.  Nominal  Group  Technique  (NGT)  and  Delphi  are 
rated  high  because  a  certain  degree  of  alignment  of  group  member's  perceptions  takes  place. 
Outranking  and  MAUT/MAVT  are  also  rated  high,  the  same  as  NGT  and  Delphi,  because  the 
complexity  of  the  problem  approached  using  these  methods  is  assumed  to  require  an  application  of 
either  one  of  the  two  alternative  generating  methods.  Morphological  connection  is  mostly  useful  for 
new  product  or  new  system  development,  and  is  rated  very  high  under  development  of  alternatives. 
Why-what’s  stopping  is  also  rated  very  high  because  the  outcome  of  this  method  is  a  highly 
comprehensive  view  of  the  problem  and  its  subproblems,  with  alternative  courses  of  action  included. 
One  potential  problem  may  be  that  presenting  such  a  broad  and  detailed  analysis  may  be  quite  a 
challenge.  AHP  is  rated  very  high  because,  although  it  may  begin  with  brainstorming  as  to  what 
alternatives  should  be  located  at  the  bottom  of  the  hierarchy,  the  level  of  problem  abstraction 
represented  by  its  hierarchy  of  criteria  provides  the  opportunity  to  question  whether  or  not  the 
alternatives  that  are  known  indicate  appropriate  breadth  for  that  level  of  abstraction. 


5.  Structure:  breadth 

This  indicator  does  not  apply  to  analogy /association,  boundary  examination, 
brainstorming/brainwriting,  and  morphological  connection,  voting,  conjoint  analysis,  and  Bayesian 
analysis.  NGT  and  Delphi  are  rated  low  because  they  are  direct  comparison  methods.  Why-what’s 
stopping,  disjointed  incrementalism,  matrix  evaluation,  outranking,  MAUT/MAVT,  and  AHP  are  rated 
high  because  they  do  not  limit  the  number  of  criteria  or  factors  considered  in  the  analysis. 


6.  Structure:  depth 

This  indicator  does  not  apply  to  analogy /association,  boundary  examination, 
brainstorming /brainwriting,  morphological  connection,  voting,  conjoint  analysis,  and  Bayesian 
analysis.  NGT  and  Delphi  are  rated  low  because  they  are  direct  comparison  methods.  Lack  of 
measurement  and  of  theoretical  foundation  for  disjointed  incrementalism  and  matrix  evaluation 
prevent  them  from  constructing  a  deep  structure,  hence  they  are  rated  low.  Goal  programming, 
outranking,  and  older  MAUT  are  rated  low  because  they  have  no  provision  for  subcriteria. 

Why -what's  stopping  and  AHP  are  rated  high  because  they  do  not  limit  the  level  of  detail  of  the 
analysis  with  respect  to  breaking  down  criteria  into  subcriteria,  sub-subcriteria  and  so  on. 


7.  Analysis:  faithfulness  of  judgments 

This  indicator,  and  all  others  here,  do  not  apply  to  analogy /association,  boundary  examination, 
brainstorming /brainwriting,  morphological  connection,  and  why -what's  stopping.  NGT  and  Delphi 
include  a  voting  process  to  determine  which  alternative  is  preferred  by  the  majority  of  the  group 
members.  However,  there  is  an  opportunity  to  use  them  together  with  a  ratio  scale  evaluation  method 
like  the  AHP.  Voting  is  rated  low  because  it  uses  an  ordinal  scale.  Disjointed  incrementalism,  matrix 
evaluation,  and  outranking  are  rated  medium  because  they  involve  assigning  numbers  which  can  be 
assumed  to  represent  intensity  of  importance  better  than  the  ordinal  rating  of  voting,  for  example. 
MAUT/MAVT  is  rated  high  because  intensity  of  preference  is  derived  from  lottery  judgments  which 
are  once  removed  from  direct  elicitation  of  preferences,  and  AHP  is  rated  very  high  because  it  elicits 
elementary  judgments. 


8.  Breadth  and  depth  of  analysis  (analysis) 
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Voting  is  rated  low  because  it  involves  judgment,  but  not  analysis.  Disjointed  incrementalism,  matrix 
evaluation,  goal  programming,  conjoint  analysis,  and  Bayesian  analysis  are  rated  medium  because 
they  are  structurally  constrained.  MAUT/MAVT  is  rated  high  because  it  provides  more  structural 
flexibility  but  it  is  difficult  to  go  back  and  review  previous  analysis.  The  AHP  is  rated  very  high 
because  its  structural  flexibility  facilitates  in-depth  analysis  of  a  problem.  It  also  provides 
inconsistency  and  incompatibility  measures  to  indicate  if  some  improvement  in  judgments,  and  some 
effort  to  align  perceptions  among  group  members  are  required.  Its  supporting  software  provides  the 
information  as  to  where  the  sources  of  inconsistency  and  incompatibility  are. 


9.  Fairness:  cardinal  separation  of  alternatives 

This  indicator  is  applicable  only  to  voting,  outranking,  MAUT/MAVT,  and  AHP.  Voting  is  rated  low 
because  it  uses  an  ordinal  scale,  and  the  others  are  rated  high  because  they  use  cardinal  scales. 
Arrow's  theorem  indicates  that  any  ordinal  preference  relation,  be  it  expressed  as  a  set  of  pairwise 
comparisons  or  point  allocations,  does  not  treat  the  alternatives  fairly. 


10.  Fairness:  prioritizing  group  members 

This  indicator  is  also  applicable  only  to  voting,  outranking,  MAUT/MAVT,  and  AHP.  Voting  is  rated 
low  because  fairness  is  operationalized  using  head  counting  with  no  regard  to  intensity  of  preference, 
which  has  been  argued  as  unsatisfactory  [Dummett,  1984],  Outranking  and  MAUT/MAVT  treat 
individual  members  of  the  group  equally.  They  may  in  fact,  implicitly  give  them  unequal  weights,  as 
for  example,  by  giving  the  boss's  opinion  greater  accord  than  that  of  other  members  of  the  group  in 
constructing  their  measures,  but  the  lack  of  method  requires  that  the  relative  weights  can  only  be 
assigned  rather  arbitrarily.  With  the  AHP,  it  is  at  the  decision-maker's  discretion  to  determine  what 
concept  of  fairness  is  appropriate.  A  hierarchy  can  be  structured,  with  the  different  individuals  at  the 
bottom  of  the  hierarchy.  The  criteria  levels  may  include  area  of  responsibilities  or  expertise  that  can 
be  used  to  prioritize  the  individuals. 


11.  Fairness:  consideration  of  other  actors  and  stakeholders 

This  indicator  is  not  applicable  to  analogy  /association,  boundary  examination, 
brainstorming /brainwriting,  and  morphological  connection  because  they  do  not  involve  problem 
analysis.  It  is  unlikely  that  this  indicator  would  be  applicable  to  Bayesian  analysis  because  of  its 
complex  cause-effect,  relationship  with  the  states  of  nature,  hence  it  is  rated  low.  Conjoint  analysis  is 
rated  low  because  it  may  be  possible  for  a  creative  user  to  represent  other  actor's  concerns  in  its 
model.  NGT  and  Delphi  are  rated  low  because  they  do  not  make  explicit  this  concern,  which  might  be 
made  implicit  by  individual  members  of  the  group.  Matrix  evaluation  is  rated  low  because  of  its 
highly  constrained  structural  representation  and  non-quantifiable  analysis.  Outranking  is  rated  low 
because  it  obtains  a  decision  with  incomplete  information,  and  its  theoretical  foundation  is  not  yet 
settled  even  for  the  most  fundamental  issues,  making  it  unlikely  that  this  concern  would  be  addressed 
and  settled  once  and  for  all.  MAUT/MAVT  is  rated  low  because,  although  it  may  incorporate  this 
concern  as  one  of  its  criteria,  its  limited  structural  representation  makes  it  difficult  to  address  the 
possible  diversity  of  actors.  Why-what's  stopping  and  disjointed  incrementalism  may  address  the  issue 
explicitly,  but  qualitatively,  and  are  rated  medium.  It  appears  that  the  AHP  is  the  only  method  that 
facilitates  for  a  group  to  explicitly  include  other  actor's  concerns  in  detail  as  parts  of  the  problem 
structure,  and  quantify  them,  hence  it  is  rated  high. 


12.  Scientific  and  mathematical  generality 
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This  indicator  is  not  applied  to  analogy /association,  boundary  examination, 

brainstorming /brainwriting,  morphological  connection,  why -what's  stopping,  NGT,  Delphi,  because 
they  do  not  involve  problem  analysis.  Disjointed  incrementalism  and  matrix  evaluation  are  rated  low 
because  they  do  not  involve  mathematics.  Voting  is  rated  medium  because  there  are  many  procedures 
proposed  for  aggregating  ordinal  votes,  with  or  without  axiomatization.  The  ones  that  are  axiomatized 
are  usually  mathematically  complex  to  deal  with  the  impossibility  inherent  in  ordinal  group 
aggregation.  Goal  programming,  and  conjoint  analysis  are  rated  medium  because  they  do  not  involve 
axiomatization.  Outranking  is  rated  medium  because  it  is  not  yet  axiomatized.  Bayesian  Analysis,  and 
MAUT/MAVT are  rated  high  because  they  are  axiomatically  solid  but  their  generalization's  have 
considerable  mathematical  difficulties.  The  AHP  is  rated  very  high  because  its  mathematical 
foundation  is  generalizable  without  additional  assumptions. 


13.  Applicability  to  intangibles 

This  indicator  is  not  applied  to  analogy /association,  boundary  examination, 
brainstorming/brainwriting,  morphological  connection,  why -what's  stopping,  NGT,  Delphi,  and 
voting  because  they  do  not  involve  problem  analysis.  Disjointed  incrementalism  and  matrix  evaluation 
are  qualitative  methods  and  are  rated  low.  Goal  programming  and  conjoint  analysis  may  incorporate 
intangibles  in  their  model,  but  they  must  be  represented  by  tangibles  with  absolute  measurement, 
hence  they  are  rated  medium.  Outranking  and  MAUT/MAVT  are  rated  medium  because  they  must  use 
absolute  measurement.  Medium  is  probably  a  generous  judgment  because  MAUT  is  riddled  with 
unresolved  paradoxes  and  problems  and  "the  standard  theory  is  being  challenged  on  several  grounds 
from  both  within  and  outside  economics  [Machina,  1987]."  Bayesian  analysis  deals  with  the 
probability  of  events,  and  is  rated  medium  because  it  often  contrives  and  guesses  at  its  prior 
probabilities  without  adequate  scientific  justification.  AHP  is  rated  very  high  because  its  fundamental 
measurement  ensures  its  applicability  to  intangibles  naturally,  that  gives  discretion  to  the  user  whether 
to  use  relative,  ideal  or  absolute  measurement  [Saaty,  1990]. 


14.  Psychophysical  applicability 

Psychophysical  applicability  does  not  apply  to  voting,  goal  programming,  and  conjoint  analysis. 
Disjointed  incrementalism,  matrix  evaluation  and  Bayes  analysis  are  rated  low  because  psychophysical 
law  is  irrelevant.  Outranking  and  MAUT/MAVT  are  rated  medium  because  they  generally  do  not 
incorporate  the  psychophysical  phenomenon.  If  they  do,  it  would  complicate  the  mathematical 
representation  of  the  theory  considerably.  AHP  is  rated  high  because  in  many  examples,  its  priority 
scales  approach  has  produced  measurement  of  responses  to  physical  stimuli  that  corresponded  closely 
to  the  normalized  values  of  physical  measurement  of  those  stimuli  in  the  homogeneous  ranges  in 
which  they  were  examined. 


15.  Applicability  to  conflict  resolution 

There  are  only  two  theories  applicable  to  conflict  resolution,  game  theory  which  is  based  on  the  utility 
theory,  and  the  AHP.  They  are  both  rated  medium. 


16.  Validity  of  the  outcome  (what  if) 

This  indicator  is  not  applied  to  analogy /association,  boundary  examination, 
brainstorming/brainwriting,  morphological  connection,  why-what’s  stopping,  NGT,  and  Delphi, 
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because  they  do  not  involve  problem  analysis.  Voting  is  rated  low  because  it  uses  ordinal 
measurement  with  no  problem  representation,  Disjointed  incrementalism  and  matrix  evaluation  are 
rated  medium  because  they  are  limited  in  terms  of  measurement  and  model  representation,  Goal 
programming,  conjoint  analysis,  and  Bayes  analysis  are  rated  medium  because  their  main  concern  is 
with  computation,  not  with  problem  representation.  Outranking  and  MAUT/MAVT are  rated  medium 
because  they  use  cardinal  measurement  with  a  relatively  simplified  model  representation.  AHP  is  rated 
high  because  its  reliance  on  ratio  scales  derived  from  paired  comparisons,  enabling  one  to  model  a 
problem  by  ordering  its  elements  and  levels  in  a  fine,  structured  way  to  legitimize  the  meaningfulness 
of  the  comparisons,  and  also  because  different  ratio  scales  can  be  multiplied  and  divided  to  obtain  an 
outcome  from  hierarchies  of  benefits,  costs,  risks,  and  opportunities. 

Research  indicates  that  sometimes  a  method  does  not  perform  as  intended.  For  example,  instead  of 
directing  decision  makers  to  profitable  investment,  a  series  of  experiments  indicate  that  the  use  of  the 
Boston  Consulting  Group  (BCG)  matrix  increases  the  subject's  likelihood  of  selecting  less  profitable 
investment  [Armstrong  and  Brodie,  1994]  due  to  misuse  of  the  method  [Wensley,  1994]. 


6.5  Discussion 

An  AHP  model  shown  in  Figure  6.1  was  developed  to  obtain  an  overall  rating  of  the  methods,  but  no 
numbers  are  included  in  it.  Our  intention  is  to  offer  an  opportunity  for  evaluating  the  methods  to  the 
reader.  We  must  confess  that  we  are  not  entirely  unbiased  in  our  preference  and  hence  we  have 
avoided  trying  to  be  too  explicit.  This  exercise  provides  an  example  of  the  absolute  rating  approach  of 
the  AHP  to  do  ranking.  The  reader  would  have  to  use  numbers  to  represent  his  or  her  judgments 
according  to  the  fundamental  scale  of  the  AHP.  Table  6.2  gives  the  criteria  and  the  intensities  for 
each  criterion  together  with  their  local  priorities.  We  believe  that  we  have  thought  through  carefully 
about  the  relative  importance  of  the  intensities  for  each  criterion  that  they  may  be  of  use  to  an 
individual  who  wants  to  establish  priorities  for  the  criteria,  and  then  select  the  appropriate  intensity 
for  each  method  on  each  criterion  and  then  obtain  the  total  for  that  method. 

We  would  like  to  note  that  not  every  decision  problem  needs  to  be  analyzed  in  a  comprehensive  and 
elaborate  way  as  one  does  with  the  AHP.  We  see  two  kinds  of  problems.  Simple  ones  that  do  not 
require  a  great  deal  of  deliberation  or  the  need  to  justify  to  someone  else  or  to  maintain  a  record.  For 
such  problems  one  often  does  not  stop  to  consciously  structure  the  decision  and  only  uses  brief  flashes 
of  thought  to  make  trade-offs  without  a  need  for  arithmetic.  In  such  cases  even  if  the  decision  is  not 
optimal,  one  soon  forgets  the  incident  and  goes  on  to  make  the  same  kind  of  decisions  in  the  same  or 
in  a  modified  way  without  a  feeling  of  inadequacy.  One  may  refer  to  this  kind  of  decision  making  as  a 
single  overall  criterion  decision,  or  decision  making  in  bulk.  Such  decision  making  is  often  done  with 
the  aid  of  straight  brainstorming. 

The  other  kind  of  decision  is  the  one  we  have  discussed  in  this  dissertation  that  requires  detailed 
analysis  with  structure  and  judgments  and  a  methodology  to  deal  with  tangibles  and  intangibles, 
benefits  and  costs  and  the  like.  The  proponents  of  these  methods  will  argue  that  their  method  is  best 
for  this  or  that  reason,  and  the  debate,  if  ever,  will  be  eventually  settled  empirically  and  also  on 
theoretical  grounds  when  there  is  sufficient  understanding  of  the  field  that  mathematicians  will  be  able 
to  determine  the  correctness  and  accuracy  of  the  various  claims.  The  AHP  is  a  tried  and  tested  tool 
for  that  purpose.  Whenever  one  has  to  make  numerical  trade-offs  among  the  criteria  and  among  the 
alternatives,  the  problem  of  the  scale  origin  of  the  numbers  becomes  preeminent.  In  that  case, 
proponents  of  different  techniques  must  show  that  all  the  operations  they  perform  on  their  numbers, 
preserve  their  integrity.  With  the  exception  of  the  AHP  and  its  derived  (not  assumed)  ratio  scales 
from  judgments  of  homogeneous  elements  based  on  an  absolute  Fundamental  Scale,  the  question  of 
what  kind  of  number  represents  the  very  final  decision  has  been  the  Achilles'  heel  of  multicriteria 
decision  making. 
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6.6  Efficiency 

The  efficiency  of  a  process  is  very  dependent  on  how  it  is  organized  and  on  its  leader  and  could  not 
be  used  as  one  of  the  criteria.  Nevertheless,  it  is  an  important  consideration.  Here  we  discuss  how  a 
facilitator  can  ensure  group  efficiency  with  the  AHP.  The  AHP  makes  group  decision  making 
intrinsically  efficient  for  at  least  three  reasons:  (1)  it  provides  a  framework  and  tools  for  group 
collaboration  that  systematize  the  group  process,  (2)  it  enables  the  group  to  break  its  task  into  distinct 
sub-tasks,  with  each  managed  almost  independently  with  respect  to  the  manpower  allocated  and  to  the 
group  techniques  used,  and  (3)  it  provides  feedback  measures  to  facilitate  judgment  improvement 
while  allowing  a  certain  degree  of  inconsistency  in  the  judgments.  The  fact  that  the  AHP  involves 
redundancy  in  judgments,  does  not  make  it  an  inefficient  method,  because  one  can  always  choose  to 
do  quick  and  dirty  evaluation  by  eliminating  redundancy,  although  one  may  get  an  inaccurate  result. 

A  facilitator  can  enhance  group  efficiency  as  follows: 


(1)  Divide  group  task  to  minimize  man-hour  utilization 

Group  decision  making  is  said  to  be  efficient  if  it  consumes  a  reasonable  amount  of  resources,  mainly 
in  terms  of  the  time  and  number  of  people  involved.  Research  indicates  that  groups  are  relatively 
more  costly  when  measured  by  the  man-hours  spent.  The  larger  the  group  size,  the  more  the  hours 
spent  by  each  person  [Shaw,  1932;  Taylor  and  Faust,  1952;  Marquart,  1955],  hence  the  smaller  the 
group  size,  the  more  efficient  the  group  process.  The  AHP  enables  a  group  to  reduce  the  amount  of 
time  spent  by  its  members  by: 

(a)  Breaking  the  group  task  down  into  a  set  of  sub-tasks:  constructing  a  hierarchy  or  parts  of  a 
hierarchy,  providing  judgments  for  a  given  hierarchy  or  parts  of  a  hierarchy. 

(b)  Determining  the  smallest  number  of  people  possible  to  complete  each  sub-task.  If  one  person  can 
do  a  job  well,  no  need  to  assign  a  team  to  do  the  job.  However,  fair  distribution  of  tasks  needs  to  be 
considered. 

(c)  Allowing  reduced  number  of  judgments  (see  Chapter  5). 

(d)  Allowing  an  acceptable  level  of  inconsistency. 

(e)  Improving  judgments  by  looking  for  both  the  most  inconsistent  judgment  and  the  individual  that 
causes  it. 

However,  for  group  decision-making,  efficiency  is  also  manifested  in  how  well  the  group  process 
moves,  does  not  get  bogged  down,  and  gets  to  the  point.  Pursuing  efficiency  is  an  achievement 
orientation  goal.  Sometimes,  the  concern  for  the  maintenance  goal  may  require  that  the  effort  towards 
greater  efficiency  be  somewhat  relaxed:  assigning  more  people  than  is  necessary,  allowing  lengthy 
discussion  on  important  matters,  or  organizing  expert  presentations  rather  than  asking  them  to  make 
judgments  for  the  group. 


(2)  Use  the  underlying  intentions  of  deferred  judgment  and  structured  communication. 

The  AHP  generalizes  the  application  of  the  concepts  of  deferred  judgment  in  brainstorming,  and 
structured  communication  in  the  NGT.  It  separates  the  process  of  problem  structuring  (which  in  turn 
consists  of  two  distinct  processes  of  identifying  the  elements  of  the  problem  and  of  defining 
dominance  relations),  judgment  elicitation,  and  evaluation.  The  group  can  conduct  brainstorming, 
NGT,  or  Delphi  sessions  to  identify  alternatives  and  criteria  efficiently. 

During  problem  structuring,  differences  with  regard  to  structuring  the  hierarchy  do  not  need  to  be 
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resolved.  This  is  a  win-win  kind  of  disagreement.  The  group  effort  should  be  focused  on  establishing 
dominance  relations  among  elements  rather  than  arguing  too  early  whether  or  not  an  element  should 
or  should  not  be  in  a  hierarchy.  If  some  elements  do  not  fit  logically  in  a  hierarchy,  consider  another 
hierarchy.  For  example,  cost  criteria  cannot  be  logically  located  in  the  same  hierarchy  with  benefit 
criteria.  Facilitate  efficiency  in  judgment  elicitation  by  ensuring  an  optimal  size  of  the  hierarchy.  If 
the  structure  is  too  deep,  encourage  the  group  to  remove  some  of  its  levels  and  learn  later  whether  or 
not  the  resulting  ambiguity  creates  difficulties  in  judgment  elicitation. 

During  judgment  elicitation,  obtaining  a  pairwise  comparison  judgment  should  be  the  end  of  a 
discussion.  For  example,  if  the  group  agrees  that  a  criterion  is  strongly  more  important  than  another, 
the  members  do  not  have  to  agree  on  the  reasoning  behind  the  judgment. 

(3)  Balance  between  consensus  and  voting 

What  makes  conventional  group  decision  making  demanding  is  that  it  is  expected  to  reach  consensus 
on  which  alternative(s)  to  select,  although  the  group  may  generally  agree  on  the  criteria  and  their 
relative  importance.  It  is  reasonable  to  assume  that  it  would  be  easier  to  reach  consensus  on 
comparing  two  things  than  on  many  things  at  once.  The  AHP  makes  it  even  easier  by  not  requiring  a 
group  to  reach  consensus  on  a  judgment.  If  voting  is  necessary  for  reasons  of  efficiency,  its  effect 
must  be  minimized.  Voting  indicates  an  individual's  incompatibility  with  the  group  and  may  lead  to 
judgment  inconsistencies.  A  narrow  range  of  judgments  can  be  ensured  by  discussing  the  differences 
first  and  selecting  the  appropriate  individuals  to  vote.  In  fact,  disagreement  and  incompatibility 
between  an  individual  and  the  group  provides  an  opportunity  for  organizational  learning.  The  majority 
are  not  always  right. 


6.7  Conclusion 

This  chapter  has  provided  us  with  a  challenging  opportunity  to  bring  many  criteria  and  many  methods 
under  one  umbrella,  which  again  illustrates  the  simplicity  and  practicality  of  the  AHP  to  deal  with 
intangibles  and  with  a  wide-ranging  set  of  alternatives.  We  believe  that  our  schematization  is  a  good 
start  and  may  eventually  be  improved  upon  in  subsequent  revisions  and  extensions  of  the  criteria  used 
and  in  debating  the  importance  of  these  criteria. 
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LEVEL  OF  INTENSITIES 


LEVELS  OF  INTENSITIES 


The  following  preliminary  intensity  levels  indicate  the  relative  level  of  importance/ 
preference/likelihood  of  the  pair-wise  comparison  between  the  various  intensity  choices  within  a 
single  (sub)  objective.  These  weights  are  also  known  as  ‘local  weights’.  These  initial  set  of 
weights  were  derived  using  AHP  before  data  collection  and  serve  as  a  starting  point  for  the 
evaluation  of  data.  It  is  likely  that  these  weights  will  change  after  more  information  is  obtained 
during  data  collection 

For  the  first  objective  (Compatibility),  the  pair-wise  comparison,  the  local  weights,  and 
the  inconsistency  ratio  is  shown.  For  the  other  objectives,  only  the  final  local  weights  are 
summarized  in  tabular  form. 

1.  BENEFIT  OBJECTIVES 

TECHNICAL  OBJECTIVES 


•  Compatibility  (COMPATIBL)  -  Compatibility  of  system  with  existing  information 
systems 


COMPATIBL 

DEFINITION 
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High  Compatible 
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Moderate  Compatible 
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BCompat 

Barely  Compatible 
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NCompat 

Not  Compatible 

.088 
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Goal 

Aiecate  Resources  to  Telemedicine  Projects  (Peaceti me)  -  Benefit 

TECHNICL 

Technical  Aspects  of  the  initatite 

COM  PAT  BL 

Compatibility  with  existhg  infcrm^ion  systems 

H_Compat 

System  is  highly  compatble  with  existing  M/iT  infrastructure 

M_Compat 

System  is  moderately  compatible  with  existing  M/fT  infrastruct. 

B_Compat 

System  is  barely  compatble  with  existing  M/IT  infrastructure 

N_Compat 

Svstem  is  not  compatible  with  IM/fT  intast  w/o  lange  amt  of  work 

Inconsistency  Ratio  =001 


HjCompat 

.483 

M_Compat 

272 

B_Ccmpat 

.157 

N_Compat 

m 
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•  Multiple  Usage  (MULT_USE)  -  Multiple  uses  of  the  same  equipment 


MULT  USE 

DEFINITION 

LOCAL 

M4_USE 

4  or  more  uses 

.483 

3  USE 

3  uses 

.272 

2  USE 

2  uses 

.157 

S  USE 

Single  Use 

.088 

Reliability  (RELIABLE)  -  Reliability  of  the  system 


RELIABLE 

DEFINITION 

FAILURE  RATE 

LOCAL 

HReliab 

Highly  reliable 

>  lx  /  month 

.483 

MJReliab 

Moderately  reliable 

lx  /  biweekly  to  lx/  month 

.272 

B  Reliab 

Barely  reliable 

lx/  week  to  1/  biweekly 

.157 

N_Reliab 

Not  reliable 

<1x7  week 

.088 

Performance  (PERFORM)  -  Performance  level  of  the  system 


PERFORM 

DEFINITION 

LOCAL 

E_Perfm 

Excellent  performance 

.483 

GPerfm 

Great  performance 

.272 

A_Perfm 

Acceptable  performance 

.157 

BPerfrn 

Barely  performed 

.088 

Standards  (STANDRDS)  -  Meeting  the  established  standards 
(transmission,  records,  etc.)  such  as  HL7,  DICOM,  TCP/IP,  H2x. 


STANDRDS 

DEFINITION 

LOCAL 

A  Std 

Met  all  standards 

.483 

M  Std 

Met  most  standards 

.272 

S  Std 

Met  some  standards 

.157 

N  Std 

Met  none  of  standards 

.088 

Speed  (SPEED)  -  Speed  of  transmission  (Available  bandwidth) 


SPEED 

DEFINITION 

LOCAL 

ATM 

ATM 

.440 

T1 

T1 

.256 

ISDN 

ISDN 

.156 

Telephn 

Telephone 

.091 

S_Modem 

Slow  Modems 

.058 

LEGEND 

Italic  objectives  -  qualitative 
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Upgrade  (UPGRADE)  -  Ease  of  system  upgrades 


UPGRADE 

DEFINITION 

LOCAL 

EaseJJG 

Easy  to  upgrade 

.540 

M_UG 

Moderately  easy  to  upgrade 

.297 

N  UG 

Not  upgradeable 

.163 

BUSINESS  OBJECTIVES 


•  Ease  of  Use  (EASE  USE)  -  Ease  of  use  of  system 


EASE  USE 

DEFINITION 

LOCAL 

V_Easy 

Very  easy  to  use 

.483 

M_Easy 

Moderately  easy  to  use 

.272 

N_Easy 

Not  easy  to  use 

.157 

VD_Easy 

Very  difficult  to  use 

.088 

•  Integration  (INTEGRTE)  -  Integration  with  existing  IM/IS  Infrastructure 


INTEGRTE 

DEFINITION 

LOCAL 

F_Integr 

Fully  integrated 

.540 

D_Integr 

Demo  mode  only 

.297 

N_Integr 

Not  integrated 

.163 

•  Market  penetration  (MARKETP)  -  Market  penetration  (use  of 
technology/total  number  of  uses) 


MARKETP 

DEFINITION 

LOCAL 

1  YR  Ago 

MP  1  year  ago 

.483 

Today 

MP  today 

.272 

lYRFutr 

Est.  1  year  MP 

.157 

>1YR  FR 

Est.  >1  year  MP 

.088 

•  Measures  of  Performance  (MOP)  -  Does  the  initiative  have  a 
clearly  written  measures  of  performance? 


MOP 

DEFINITION 

LOCAL 

Y_MOP 

Have  MOPs 

.800 

N  MOP 

Do  not  have  MOPs 

.200 

LEGEND 

Italic  objectives  -  qualitative 
Bold  objective  -  quantitative 


Patient  (PATIENT)  -  Primary  patient  population 


PATIENT 

DEFINITION 

LOCAL 

AD  PT 

Active  duty 

.483 

DEP  PT 

Dependents 

.272 

RET_PT 

Retirees 

.157 

OTHERPT 

Others 

.088 

•  Political  (POLITICAL)  -  The  political  support  for  the  initiative 


POLITICAL 

DEFINITION 

LOCAL 

H_Supprt 

Highly  supported 

.540 

M_Supprt 

Moderately  supported 

.297 

N_Supprt 

Not  supported 

.163 

•  Plan  (PLAN)  -  Does  the  initiative  have  a  written  business  or 
project  management  plan? 


PLAN 

DEFINITION 

LOCAL 

Y_Plan 

Have  a  plan 

.800 

N_Plan 

Do  not  have  a  plan 

.200 

•  Usage  Level  (USGEJLVL)  -  The  level  of  system  usage 


USAGE  LVL 

DEFINITION 

LOCAL 

FI  Used 

High  usage  level 

.483 

M  Used 

Moderate  usage  level 

.272 

A  Used 

Acceptable  usage  level 

.157 

BJUsed 

Barely  used 

.088 

DELIVER  OF  CARE  (CARE)  OBJECTIVES 

•  Approvals  (APPRO VL)  -  Approval  of  system  by  review  board(s)  and/or  FDA 


APPROVL 

DEFINITION 

LOCAL 

YESAppr 

Approval  obtained 

.540 

OG_Appr 

Approval  on-going 

.297 

N_Appr 

Not  approved 

.163 

LEGEND 

Italic  objectives  -  qualitative 
Bold  objective  -  quantitative 


Efficiency  (EFFICNCY)  -  Efficiency  in  quality  of  care 


EFFINCY 

DEFINITION 

LOCAL 

fflJEffic 

Highly  improved 

.483 

MI_Effic 

Moderately  improved 

.272 

BI  Effic 

Barely  improved 

.157 

NI  Effic 

Not  improved 

.088 

Quality  (QUALITY)  -  Quality  of  care 


QUALITY 

DEFINITION 

LOCAL 

HI  Qual 

Highly  improved 

.483 

MI  Qual 

Moderately  improved 

.272 

BI  Qual 

Barely  improved 

.157 

NIQual 

Not  improved 

.088 

Safety  (SAFETY)  -  Safety  of  equipment/procedure 


SAFETY 

DEFINITION 

LOCAL 

CS_Safe 

Completely  safe 

.540 

AS  Safe 

Assumed  safe 

.297 

N_Safe 

Not  safe 

.163 

Satisfaction  (SATISF)  -  Patient  satisfaction  level  with  procedure/system/technology 


SATISF 

DEFINITION 

LOCAL 

V_Sat 

Very  satisfied 

.483 

M  Sat 

Moderately  satisfied 

.272 

B  Sat 

Barely  satisfied 

.157 

U  Sat 

Unsatisfied 

.088 

Security  (SECURE)  -  Patient  privacy,  information  security  and  confidentiality 


SECURE 

DEFINITION 

LOCAL 

C_Secure 

Completely  secure 

.540 

B_Secure 

Barely  secure 

.297 

U_Secure 

Unsecure 

.163 

LEGEND 

Italic  objectives  -  qualitative 
Bold  objective  -  quantitative 


2. 


COST  OBJECTIVES 


TECHNICAL  OBJECTIVES 


•  Maintenance  (MAINTAIN)  -  Maintenance  requirements  of  the  system 


MAINTAIN 

DEFINITION 

MEAN  TIME 
BETWEEN  FAILURE 

LOCAL 

L_Maintn 

Low  maintenance 

>  lx  /  month 

.483 

A_Maintn 

Acceptable  maintenance 

lx/ biweekly  to  1 /month 

.272 

M_Maintn 

Moderate  maintenance 

lx/  week  to  1/  biweekly 

.157 

H_Maintn 

High  maintenance 

>lx  /  week 

.088 

•  Size  (SIZE)  -  Size  of  the  Equipment 


SIZE 

DEFINITION 

LOCAL 

Neg_Sz 

Negligible  Size 

.483 

Port  Sz 

Portable 

.272 

Tr_Sz 

Transportable 

.157 

Fixed_Sz 

Fixed 

.088 

•  Weight  (WEIGHT)  -  Weight  of  the  equipment 


WEIGHT 

DEFINITION 

POUNDS 

LOCAL 

VL  Wt 

Very  light  weight 

<10  lbs. 

.440 

L_Wt 

Light  weight 

10-20  lbs. 

.256 

A  Wt 

Acceptable  weight 

20-50  lbs. 

.156 

Mod_Wt 

Moderate  weight 

50-100  lbs. 

.091 

Heavy_Wt 

Heavy  weight 

>  100  lbs. 

.058 

•  Assembly  (ASSEMBLY)  -  Level  of  difficulty  in  assembling  the  equipment 


ASSEMBLY 

DEFINITION 

LOCAL 

E_Asmbly 

Easy  to  assemble 

.540 

M_Asmbly 

Moderately  easy  to  assemble 

.297 

D_Asmbly 

Difficult  to  assemble 

.163 

LEGEND 
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•  Customization  (CUSTOM)  -  Customization  level  of  the  equipment 


COSTOM 

DEFINITION 

LOCAL 

COTS/GOTS 

Commercial/Government 

off-the-shelf 

.483 

ENH  COTS 

Enhanced  COTS 

.272 

CUS  EQ 

Custom  equipment 

.157 

PROTOTYP 

Prototype 

.088 

BUSINESS  OBJECTIVES 


•  Facility  (FACILITY)  -  Facility  Requirements 


FACILITY 

DEFINITION 

SQUARE  FT 

LOCAL 

NjFloorS 

No  floor  space 

No  floor  space  - 
Desktop 

.440 

S_FloorS 

Some  floor  space 

<  100  sq  ft 

.256 

M_FloorS 

Moderate  floor  space 

100-500  sq  ft 

.156 

L_FloorS 

Large  floor  space 

>  500  sq  ft 

.091 

Ded_Fac 

Dedicated  facility 

Dedicated  facility 

.058 

•  Initial  Capital  Requirements  (ICAPITAL)  -  Initial  capital  investments 


ICAPITAL 

DEFINITION 

COSTS 

LOCAL 

VS  ICAP 

Very  small  initial  capital 

<$10K 

.440 

S  ICAP 

Some  initial  capital 

$10K-$100K 

.256 

M  ICAP 

Moderate  initial  capital 

$100K-$500K 

.156 

LJCAP 

Large  initial  capital 

S500K  -$1M 

.091 

VI.JCAP 

Very  large  initial  capital 

$1M 

.058 

•  On-going  Capital  Requirements  (OCAPITAL)  -  On-going  monthly  capital 
investments 


OCAPITAL 

DEFINITION 

COSTS 

LOCAL 

VS_OCAP 

Very  small  on-going  capital 

<  $5K 

.440 

S  OCAP 

Some  on-going  capital 

S5K-S10K 

.256 

M  OCAP 

Moderate  on-going  capital 

S10K-S25K 

.156 

L  OCAP 

Large  on-going  capital 

$25K  -$50K 

.091 

VL  OCAP 

Very  large  on-going  capital 

S50K 

.058 

LEGEND 
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Scheduling  (SCHEDUL)  -  Scheduling  Requirements 


SCHEDUL 

DEFINITION 

LOCAL 

YSched 

Yes-  scheduling  required 

.800 

N_Sched 

No  scheduling  required  -  on  demand 

.200 

•  Training  (TRAINING)  -  Initial  system  training  requirements 


TRAINING 

DEFINITION 

# HOURS 

LOCAL 

VS  Trng 

Very  small  level 

<  1  hour 

.440 

S_Trng 

Small  level 

1-4  hour 

.256 

A_Trng 

Acceptable  level 

4-8  hour 

.156 

M_Trng 

Moderate  level 

1-3  days 

.091 

L_Tmg 

Large  level 

>  3  days 

.058 

•  Transmission  Cost  (TRANS$)  -  Monthly  transmission  costs 


TRANSS 

DEFINITION 

$  PER  MONTH 

LOCAL 

L_Transm 

Low  transmission  $ 

<  $  100/m 

.483 

M_Tranm 

Moderate  transmission  $ 

$100-$lK/m 

.272 

HTransm 

High  transmission  $ 

$lK-$5K/m 

.157 

VH_Transm 

Very  high  transmission  $ 

>$5K/m 

.088 

DELIVERY  OF  CARE  (CARE)  OBJECTIVES 


•  Clinician  Inconveniences  ( CjCONV)  -  Level  of  clinician  inconvenience 


C  INCONV 

DEFINITION 

LOCAL 

LCIConv 

Low  clinician  inconvenience 

.540 

S  CIConv 

Some  clinician  inconvenience 

.297 

M  CIConv 

Moderate  clinician  inconvenience 

.163 

•  Confinement  (CONFINE)  -  Patient  confinement  requirement  (in  room,  in  machine, 
etc.) 


CONFINE 

DEFINITION 

LOCAL 

L_Confn 

Little  confinement 

.540 

S  Confn 

Some  confinement 

.297 

M_Confn 

Moderate  confinement 

.163 
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Patient  Delays  (DELAY)  -  Patient  delays  before,  during,  or  after  the  TMED  session 


DELAY 

DEFINITION 

LOCAL 

L_Delay 

Little  delay 

.540 

S_Delay 

Some  delay 

.297 

M_Delay 

Moderate  delay 

.163 

Patient  Discomfort  (DISCMFT)  -  Level  of  patient  discomfort 


DISCOMFT 

DEFINITION 

LOCAL 

L_Discmf 

Low  discomfort 

.540 

S_Discmf 

Some  discomfort 

.297 

M_Discmf 

Moderate  discomfort 

.163 

Patient  Inconveniences  (P  INCONV)  -  Level  of  patient  inconvenience 


P INCONV 

DEFINITION 

LOCAL 

L_PIConv 

Low  patient  inconvenience 

.540 

S  PIConv 

Some  patient  inconvenience 

.297 

MPIConv 

Moderate  patient  inconvenience 

.163 

Patient  Movement  (MOVEMNT)  -  Required  patient  movement 


MOVENNT 

DEFINITION 

LOCAL 

L_Move 

Little  movement 

.540 

S_Move 

Some  movement 

.297 

M_Move 

Moderate  movement 

.163 

LEGEND 
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3. 


RISK  OBJECTIVES 


•  Technical  ( TECHRK )  -  The  failure  to  develop  or  procure  any  element,  component, 
end-item,  or  subsystem 


TECHRK 

DEFINITION 

LOCAL 

VH  T  RK 

Very  high  technical  risk 

.440 

H_T_RK 

High  technical  risk 

.256 

M  T  RK 

Moderate  technical  risk 

.156 

A_TRK 

Acceptable  technical  risk 

.091 

L_T_RK 

Low  technical  risk 

.058 

•  Cost  (COSTRK)  -  Any  variation  in  predicted  costs  that  exceeds  an  acceptable  level 


COSTRK 

DEFINITION 

LOCAL 

VHCRK 

Very  high  cost  risk 

.440 

H  C  RK 

High  cost  risk 

.256 

M  C  RK 

Moderate  cost  risk 

.156 

A  C  RK 

Acceptable  cost  risk 

.091 

L  C_RK 

Low  cost  risk 

.058 

•  Schedule  Risk  (RK)  -  Failure  to  meet  any  pram  milestone  and/or  complete  any  major 
event  within  an  acceptable  time 


SCHEDRK 

DEFINITION 

LOCAL 

VH  S  RK 

Very  high  schedule  risk 

.440 

H  S  RK 

High  schedule  risk 

.256 

M  S  RK 

Moderate  schedule  risk 

.156 

A  S  RK 

Acceptable  schedule  risk 

.091 

L  S  RK 

Low  schedule  risk 

.058 

LEGEND 
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Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 


Strategic  Technology  Planning  for  the 
U.S.  Army  Medical  Department 


Technology  Profile 


TELEMEDICINE 


AMEDD  Re-Engineering  Laboratory  (REL)  Toigo  Associates,  Inc. 

12.4.97 


PROPRIETARY 

-1- 


Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 
Re-Engineering  Laboratory  (REL) 


INITIATIVE  DESCRIPTION 

1 .  Title  of  initiative: 

2.  Initiative  leader/principal  investigator: 

3.  Address: 

4.  Describe  the  initiative  objectives: 

5.  Describe  the  technologies  being  used  in  this  initiative: 

6.  Describe  an  application  scenario: 

7.  Describe  the  current  practice,  and  how  the  new  technology  will  alter  that 
practice: 

8.  Describe  the  plan  for  transitioning  the  initiative  to  widespread  use  (if  any): 

9.  Describe  the  competing  or  alternative  solutions  and  technologies: 

1 0.  Provide  a  flow  diagram  of  the  current  practice: 

1 1 .  Provide  a  flow  diagram  using  the  new  process  (technology): 

1 2.  At  what  sites  is  the  initiative  being  applied  (specify  primary  and 
secondary ): 

13.  Key  personnel  (name,  title,  level  of  effort,  status-AD/DOD 

civilian/contractor/other)  (provide  for  each  site): 

Clinical  leaders: 

Technical  leaders: 

Administrative  leaders: 

End  users/customers: 

14.  Date  i  n  itiative  sta  rted : 

15.  Anticipated  ending  date: 

16.  What  is  the  initiative  status? 

17.  Who  is  the  proponent? 

18.  Who  is  the  sponsor? 

19.  Who  is  the  end  use? 

□  Individual  (one  per  soldier) 

□  Combat  arms 
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Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 

□  Combat  support  and  combat  services  support 

□  Team 

□  Unit  (echelon  1  or  2) 

□  Unit  (echelon  3  or  4) 

□  Sustaining  base 

20.  Who  are  the  fund  providers? 

21 .  What  is  the  current  funding  for  the  initiative  ( source ,  amount,  and 
duration )? 

22.  What  remains  to  be  done  before  the  product/process  is  available  for  use 
(what  will  it  take  to  develop  and  implement  -  R&DD  requirements)? 

23.  What  design,  development,  and  implementation  problems  and  barriers  are 
anticipated? 

24.  How  will  these  barriers  affect  availability? 

25.  What  are  the  benefits  of  the  technology  (advantages)? 

26.  What  are  the  risks  of  the  technology  (disadvantages)? 

27.  What  are  the  limitations  of  the  technology? 

28.  What  are  other  uses  for  the  technology? 

□  Within  AMEDD 

□  Within  MHSS 

□  External  to  DOD 

29.  What  happens  if  the  new  technology  is  note  developed  or  implemented? 

30.  How  will  the  current  business  practice  needs  to  be  changed  to 
accommodate  the  new  technology? 

31 .  Where  will  the  technology  be  used? 

32.  Type  of  Technology 

□  Diagnostic 

□  Therapeutic 

□  Public  Health 

□  Preventive 

□  Rehabilitative 

□  Administrative 
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Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 


33.  Exportability 

34.  Current  initiative  use 

35.  Technology  Source 

□  Non  Developmental  Item 

□  COTS 

□  GOTS 

□  Developmental 

□  Enhanced  (customized)  COTS/GOTS 

□  Custom  (“one-of) 

□  Prototype 

36.  What  is  the  current  life  cycle  phase? 

□  DOD  (non-programmatic) 

□  DOD  Program 

□  6.1 
□  6.2 

□  6.3 

□  6.3a 

□  6.3b 

□  6.4 

□  6.5 

□  P2 

□  P8 

37.  What  is  the  role  of  AMEDD  in  this  initiative? 

□  Researcher  -  determines  fundamental  knowledge  related  to  the 
scientific  or  engineering  field  being  investigated 

□  Developer  -  solves  technical  and  engineering  problems  related  to  the 
production  of  a  finished  product 

□  System  Integrator  -  combines  products  from  multiple  sources  into  a 
unique  product,  may  add  proprietary  hardware  or  software  to  system 
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□  Evaluator  -  conducts  or  participates  in  clinical  or  technical  trials, 
including  usability  testing 

□  Advisor  -  provides  clinical,  military,  or  technical  expertise  to 
developers 

□  None 

38.  What  is  the  anticipated  value  (benefit)  of  the  technology? 

□  Keeps  AD  forces  on  the  job 

□  Saves  lives 

□  Keep  beneficiaries  at  work  or  at  home 

□  Reduces  medical  evaluation  missions 

□  Reduces  MHSS  skill  mix  and  size  MHSS  staffing  model 

□  Maintain  military  readiness  skills  of  MHSS  staff 

□  Reduce  health  services  requirements  of  TRICARE  support  contractors 

□  Enhance  and  measure  health  and  fitness  of  beneficiaries 

□  Marketing 

□  Morale 

39.  What  is  the  mission  orientation  for  the  initiative? 

□  Non  Developmental  Item 

□  Force  initiation  (combat) 

□  MOUT 

□  Peace  operations 

□  Humanitarian  assistance 

□  Garrison/sustaining  base 

□  Beneficiary  care 

40.  What  benefit  will  the  technology  have  for  each  mission?  (anticipated 
distribution  in  percentage  of  total  use) 
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Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 


OPERATIONAL  ENVIRONMENT 

□  Disease  Management  (direct  clinical  care  of  DNBI) 

□  Combat  Casualty  Care  (trauma  management)  reduce  deaths,  enhance 
ability  to  continue  mission  performance  in  wounded  casualties) 

□  Battle  injuries 

□  Combat  stress 

□  WMD 

□  Preventive  (Dx  and  prevent  illness/injuries) 

□  Soldier  Performance  (performance  monitoring,  optimization) 

□  Education/Training 

□  Clinical  Informatics  (CIS,  LIS,  RIS) 

□  Logistical 

□  Administrative  Support  (C4I) 

□  Dental 

□  Veterinary 

□  Food  Services 

□  Animal  Care 

□  Laboratory 

□  Health  Promotion 

□  Rehabilitation 

BENEFICIARY  CARE 

□  In  MTF 

□  TRICARE 

□  Civilian  (not  TRICARE) 
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Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 


TECHNICAL 

1 .  What  technologies  are  being  applied?  (describe  each  in  detail) 

□  Hardware 

□  Software 

□  Process 

□  Computer 

□  Telecommunications 

□  Display 

□  Image  processing 

□  Sensor 

□  Network  devices 

□  Simulation  and  modeling 

□  Training 

2.  What  standards  are  used  (e.g.,  HL7,  DICOM,  H32x,  TCP/IP)? 

□  Device 

□  Software 

□  Networking 

3.  What  technologies  must  be  in  place  or  available  for  the  initiative  to  work? 

4.  What  are  the  bandwidth  requirements  and  load? 

5.  What  integration  with  telecommunications  network  has  occurred? 

□  Military 

□  Civilian 

6.  Who  is  the  provider  or  the  developer  of  the  technology? 

7.  Is  the  system  technically  sound? 

8.  Is  the  proposed  initiative  technically  feasible? 

9.  What  is  the  level  of  activity  in  competing  approaches  that  would  reduce 
the  value  of  the  technology  being  developed  (e.g.,  improved  training  or 
behavioral  changes)? 

1 0.  What  are  the  secondary  technologies  required  to  use  this  technology? 

PROPRIETARY 

-7- 


Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 


1 1 .  What  is  the  weight/cube  (footprint)  of  the  technology  being  evaluated/of 
entire  system)? 

□  Current 

□  Target 

12.  What  is  the  compatibility  with  IM/IT  systems? 

□  Existing 

□  Planned 

1 3.  What  are  the  environmental  implications? 

□  Power  requirements  and  sources 

□  Personnel  risks  and  hazards 

□  Environmental  hazards 

□  Signature/exposure  (physical/electronic) 

14.  What  category  is  the  technology? 

□  Disposable  (single  use) 

□  Limited  re-use 

□  Durable 

15.  What  is  the  reliability  level  (%  times  use  successful/%  time  uses 
attempted) 

16.  What  are  the  serviceability  requirements? 

□  Routine 

□  Unscheduled 

17.  How  are  the  technical  support  services  provided? 

MARKET 

1 .  For  what  disease(s)  or  condition(s)  will  the  technology  be  applied  (IDC-0 
or  CPT  codes)? 

2.  What  is  the  incidence/prevalence  for  the  disease  (s)  or  condition(s)? 

3.  What  fundamental  value  is  added  to  the  technology  by  AMEDD  efforts 
and  investments? 

4.  What  value  is  added  to  AMEDD  business  practice  by  the  technology? 
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Strategic  Technology  Planning  for 
the  U.S.  Army  Medical  Department 

Re-Engineering  Laboratory  (REL) 


5.  What  is  driving  the  technology  development? 

□  Investigator  academic  or  clinical  interests  (investigator  initiated) 

□  AMEDD  Program  (USAMRMC,  AMEDD  C&S,  Others) 

6.  What  is  commercially  available  today? 

7.  What  is  the  anticipated  product  life  cycle? 

8.  What  is  the  initial  cost 

9.  What  per  unit  cost  seems  attainable? 

10.  What  is  the  long-term  effect  on  organizational  business  practices? 

1 1 .  What  specialized  training  is  required? 

12.  What  level  of  personnel  support  is  required? 

1 3.  What  are  costs  of  competing  technologies? 

14.  What  unique  equipment  is  required? 

15.  What  is  the  infrastructure  costs? 

16.  What  are  the  operating  and  maintenance  costs  per  use  and  life  cycle? 

17.  How  often  is  the  technology  applied  to  each  patient? 

1 8.  Are  there  disposables? 

1 9.  What  is  the  level  of  customer  awareness? 

20.  Are  the  customers  risk  averse? 

21 .  What  is  the  threshold  level  of  investment  (minimum  necessary  investment 
in  development  to  ensure  success)? 

22.  What  is  the  total  market  size  (#  and  $)? 

□  Army 

□  DOD 

□  Govt  (non-DOD) 

□  Non-US  Govt 

□  Commercial 

□  US 

□  International 

23.  Are  there  third  party  payers  that  will  reimburse  for  this  technology? 

□  Capital  expenditure 

□  Use 
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Re-Engineering  Laboratory  (REL) 

24.  Who  are  the  medical  care  providers  that  will  be  using  this  technology? 

25.  How  will  access  to  the  technology  be  determined? 

26.  What  concept  of  operations  (doctrine)  will  be  applied? 

27.  Intellectual  property  ownership: 

□  Government  owned  IP 

□  Royalty-free  use 

□  Licensed  use 

□  Academic  IP 

□  Non-profit  IP 

□  Industry  IP 

□  No  IP 

□  Unknown 

□  Shared  IP 

28.  Level  of  technologies  used 

□  Base/Core 

□  New  (diffusion  stage) 

□  Established 

□  Emerging 

□  Obsolete 

□  Idealized  unknown  basic  technology 

29.  What  are  the  enabling  technologies  required? 

30.  Impact  on  business  process: 

□  Minor  product  or  process  improvement 

□  Major  product  or  process  improvement 

□  New  to  the  market  or  process 

□  Breakthrough  product  or  process  (novel  state-of-the-art) 

31.  Barriers  to  entry 

□  Developmental  cost 

□  Unit  cost 
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□  Complexity 

□  Physician/medic  resistance 

□  Patient  resistance 

□  Immaturity 

□  Competing  product  or  technology 

32.  FDA  Regulatory  status: 

33.  Acquisition  status: 

34.  Implementation  status: 

35.  Termination  (obsolescence  date): 

36.  What  is  the  rate  of  adoption  of  the  technology? 

37.  Diagram  the  technology  acceptance  life  cycle? 

38.  Anticipated  time  to  mainstream  acceptance  and  use: 

□  Today  (1997-2000) 

□  Transition  (2000-2005) 

□  Force  XXI  (2005-2010) 

□  AAN  (2010-2020) 

□  Army  of  the  future  (past  2020) 

39.  Customer  base  (market  size): 

□  Number  of  users 

□  Number  of  units  (devices) 

□  Number  of  uses/time  unit 

□  Number  of  units  in  use  now  (devices,  seat  licenses) 

□  Total  number  of  units  needed  (anticipated) 

40.  Market  penetration  ( customer  using  the  technology/total  number  of 
customers ) 

□  Today 

□  Yr  ago _ 

□  2  Yr  from  now 

□  #  of  episodes  in  which  technology  is  used/total  #  of  episodes _ 
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CLINICAL  EVALUATION 

Is  there  Clinical  Evaluation  being  performed? 

If  Yes  -  initiative  principal  investigator  to  provide  available  data  for  profile: 

1 .  What  specific  data  is  being  collected  or  is  available? 

2.  How  is  the  data  collected? 

3.  What  were  the  criteria  for  using  the  technology? 

4.  Is  there  human  subject  study  approval  for  the  initiative/technology? 

5.  Who  is  the  approving  IRB? 

6.  What  are  inclusion  criteria? 

7.  What  are  exclusion  criteria? 

8.  How  was  the  sample  population  selected? 

9.  Total  number  of  population  with  the  condition  or  disease? 

10.  Number  of  subjects  lost  to  follow  up 

1 1 .  What  was  the  reason  for  the  subject  withdrawal? 

12.  What  study  design  was  used? 

1 3.  What  study  design  was  used? 

14.  How  ill  Ql/P!  be  performed? 

15.  How  is  informed  consent  obtained? 

16.  What  standards  of  care  will  be  applied? 

1 7.  What  are  the  risks  of  the  technology? 

18.  What  are  the  liability  implications? 

19.  What  statistical  methods  were  applied  (specific  tests  or  techniques)? 

20.  Was  the  effect  of  technology  application  adjusted  for  covariates? 

21 .  What  clinical  end  points  were  used  to  judge  success  of  the  technology? 

22.  How  many  independent  observers  evaluated  the  endpoints? 

23.  To  what  standard  was  the  technology  compared  (“gold  standard”) 

24.  Was  the  technology  evaluated  over  a  broad  spectrum  of  patients? 

25.  Over  what  period  of  time  were  results  evaluated  (patients  followed)? 
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26.  Were  technical  problems  recorded? 

27.  What  was  the  sensitivity/specificity/PPV/NPV/accuracy/reproducibility? 

28.  Are  there  other  studies  using  the  same  or  similar  technologies? 

29.  How  effective  is  the  technology  (what  is  the  probability  of  benefit  to 
individuals  in  a  defined  population  when  the  technology  is  applied  to  a 
given  medical  problem  under  conditions  of  average  use?  Of  ideal  use)? 

30.  Did  any  patients  discontinue  the  use  of  the  technology? 

31 .  What  were  the  effects  of  telemedicine  application  on  the  clinical  process 
of  care  compared  to  the  alternative  (s)? 

32.  What  were  the  effects  of  telemedicine  application  on  immediate, 
intermediate,  r  long-term  health  outcomes  compared  to  the  alternatives? 

33.  Did  telemedicine  affect  the  use  of  services  or  the  level  of  appropriateness 
of  care  compared  to  the  alternative? 

34.  Did  the  application  affect  the  timeliness  of  care  or  the  burden  of  obtaining 
care  compared  to  the  alternatives? 

35.  What  were  the  costs  of  the  telemedicine  application  for  participating 
health  care  providers  or  health  plans  compared  to  the  alternatives? 

36.  What  were  the  costs  of  the  telemedicine  application  for  patients  and 
families  compared  to  the  alternatives? 

37.  What  were  the  costs  for  society  overall  compared  to  the  alternatives? 

38.  How  did  the  costs  of  the  application  relate  to  the  benefits  of  the 
telemedicine  application  compared  with  the  alternatives? 

39.  Were  patients  satisfied  with  the  telemedicine  service  compared  to  the 
alternatives? 

40.  Were  attending/consulting  clinicians  satisfied  with  the  telemedicine 
compared  with  the  alternatives? 


ENVIRONMENT  (Clinical,  Military,  Policy,  Regulatory,  Ethical,  and  Social) 


1 .  Is  such  a  technology  acceptable  to  users  within  the  context  of  use? 

2.  Are  there  social  considerations  involved  in  the  application  of  the 
technology? 

3.  Will  the  technology  increase  or  decrease  demands  on  the  healthcare 
system? 
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4.  What  are  the  ethical  considerations  in  the  use  of  the  technology? 

5.  Is  the  technology  used  as  anticipated? 

6.  Does  the  technology  produce  the  desired  results? 

7.  Does  the  technology  work  better  than  the  procedure  it  replaced? 

8.  Describe  the  education  and  training  necessary  for  use  of  the  technology: 

9.  How  well  must  individuals  be  trained  to  effectively  use  the  system? 

10.  How  well  have  individuals  actually  been  trained? 

11.  To  what  extent  does  value  of  this  technology  depend  on  practice  setting? 

12.  In  what  population  is  the  technology  applied  most  effectively? 

13.  What  are  the  impacts  on  the  healthcare  system  at  large? 

14.  Did  any  medical  personnel  refuse  to  use  or  discontinue  the  use  of  the 
technology? 


PROPRIETARY 

-14- 


APPENDIX  G 


TECHNOLOGY  PROFILE  -  2nd  DRAFT 


Re-Engineering  Laboratory  (REL) 

Strategic  Technology  Planning  for  the  U.S.  Army  Medical 

Department 


Technology  Profile 


TELEMEDICINE 

Process  Outline 
User  Survey 
Technology  Profile 


Toigo  Associates,  Inc. 
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REL-Technology  Profile 
TELEMEDICINE 


User  Survey  i„„18tl„e  POc 

\ _ , 

Brief  and  Site  Visit  REl Team 
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REL-Technology  Profile 
TELEMEDICINE 


Telemedicine  Initiative 

User  Survey 

To  be  completed  by  initiative  site  and  returned  before  briefing  and  site  visit 


Title  of  initiative: 


Point  of  contact: 

Name: 

Title: 

Address: 

Telephone: 

FAX: 

Email: 

URL: 

Initiative  proponent  or  sponsor: 


Description  of  initiative: 

describe  the  overall  objective,  current  practice  or  approach,  limitations  of  current  practice  that  will  be 
addressed  by  the  new  technology,  and  method for  using  the  new  technology 


Application  scenario: 

provide  one  or  more  examples  of  use,  focusing  on  the  clinical  environment,  when  appropriate 


List  sites  at  which  the  technology  will  be  used: 


Timeline  of  initiative: 

date  work  started,  date  of  first  clinical  use,  date  of full  implementation,  anticipated  length  of  project 


Accomplishments  to  date: 


System  components: 

list  hardware,  software,  networking,  telecommunications  requirements) 
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REL-Technology  Profile 
TELEMEDICINE 

Telemedicine  Initiative 

Technology  Profile 

To  be  completed  by  the  REL  Team 


MISSION 

1 .  Category  of  Technology  %  time  used  for  each 

Direct  clinical  care: 

□  diagnostic  _ 

□  therapeutic  _ 

□  preventive  _ 

Non-clinical  use: 

□  administrative  _ 

□  education/training  _ 

□  health  promotion  _ 

□  logistical  _ 

□  marketing/improve  morale  _ 

2.  Application  Environment 

Combat  casualty  care 

□  reduce  battlespace  deaths(KIA)  _ 

□  reduce  evacuations  _ 

□  reduce  combat  stress  _ 

Keep  AD  forces  on  job 

□  disease  management  (DNBI)  (deployed)  _ 

□  disease  management  (DNBI)  (sustaining  base)  _ 

□  Preventive  (deployed)  _ 

□  Preventive  (sustaining  base)  _ 

□  Humanitarian  assistance  (non-DOD  beneficiary)  _ 

□  Sustaining  base  (beneficiary  care)  _ 

□  Reduce  MHSS  skill  mix  and  staffing  _ 

□  Reduce  health  service  requirements  of 

TRICARE  support  contractors  _ 

□  Keep  beneficiaries  at  work  or  home  _ 
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REL-Technology  Profile 
TELEMEDICINE 


3.  End  User 

□  Individual 

□  Combat  arms  _ 

□  Combat  service  support  _ 

□  Unit  (Echelon  1-2)  _ 

□  Unit  (Echelon  3-4)  _ 

□  Sustaining  base  (Echelon  5,  CONUS)  _ 

4.  Role  of  AMEDD  in  this  initiative 

□  Researcher 

determines  fundamental  knowledge  related  to  the  scientific  or  engineering  field  being  investigated 

□  Developer 

solves  technical  and  engineering  problems  related  to  the  production  of  the  finished  product 

□  Systems  Integrator 

combines  products  from  multiple  sources  intoa  unique  product,  may  add  proprietary  hardware  or 
software  to  system 

□  Evaluator 

conducts  or  participates  in  clinical  or  technical  trials,  including  usability  testing 

□  Advisor 

provides  clinical,  military,  or  technical  expertise  to  developers 

□  None 

5.  Initiative  Driver 

□  Investigator-initiated  (investigator  academic  or  clinical  interests) 

□  Centrally  directed  (usamrmc,  dod-ha,  amedd  c&s,  etc.) 

6.  How  is  access  to  the  initiative  determined? 

What  patients  and  providers  participate?  How  are  they  selected? 

7.  Customer  base 

number  of  users  _ 

number  of  units/devices  _ 

number  of  uses  per  time  unit  _ 

number  of  units  in  use  now  _ 

total  number  of  units  needed 


8.  Market  penetration 

Uses  of  the  technology/total  incidence  or  number  of  uses 

one  year  ago 
today 

one  year  from  now  (estimated) 
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REL-Technology  Profile 
TELEMEDICINE 

MATURITY 

9.  Technology  Sources 

list  all  that  apply 

Non-deve!opmental  item 

□  commercial  off-the-shelf  (COTS) 

□  government  of-the-shelf  (GOTS) 

Developmental 

□  enhanced  (customized)  GOTS/COTS 

□  Custom  (“one-off,”  finished  product) 

□  prototype  (as  a  phase  of  development) 

10.  Integration  with  existing  IM/IS  infrastructure 

□  Yes 

□  full  functionality 

□  demonstration  mode  only 

□  No 

11.  Anticipated  time  to  mainstream  acceptance  and  use 

□  Today  (1997-2000) 

□  Transition  (2000-2007) 

□  Force  XXI  (2007-2017) 

□  Army  After  Next  (2017-2025) 

□  Army  of  the  future  (beyond  2025) 

12.  Barriers  to  entry 

□  development  cost 

□  unit  cost 

□  complexity 

□  physician/provider  resistance 

□  patient  resistance 

□  immature  technology 

□  competing  product  or  practice 

13.  FDA  regulatory  status 

□  None 

□  Under  review 

□  501k 

□  PMA 

□  Approved 
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TELEMEDICINE 


PERFORMANCE 

14.  Describe  the  system  components 

model,  peripherals,  software  version,  weight/cube,  power  requirements,  MILSPEC, 
etc. 

Hardware 

Software 

Networking 

Telecommunications 


15.  What  data  fields  are 

acquired: 

transmitted: 

archived: 

16.  How  is  data  transmitted? 

17.  What  are  the  bandwidth  requirements? 

18.  What  data  standards  are  currently  used? 

(e.g.,  HL7,  DICOM,  TCP/IP,  H32x) 

19.  What  is  the  system  load  ? 

(frequency  of  use,  time  per  use) 

20.  How  is  integration  with  existing  IM/IS  resources  achieved? 

21.1s  the  system  used  in  a  clinical  evaluation  process? 

22.  Is  the  process  approved  by  a  duly  constituted  institutional  review 
board? 
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TELEMEDICINE 

RELIABILITY 

23.  What  is  the  reliability  level? 

number  of  times  use  is  successful/number  of  times  use  attempted 

24.  What  are  the  service  requirements? 

routine: 

unscheduled: 

25.  What  personnel  are  allocated  to 

system  administration: 
technical  service  support: 

26.  In  what  environments  is  the  system  designed  to  operate? 


27.  In  what  field  environments  has  the  system  been  tested? 

28.  What  training  is  required  before  using  the  system? 
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REL  TRAVEL/MEETING  SUMMARY 
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TRICARE  SOUTHWEST  BROCHURE 


TRICARE  Southwest  Brochure 
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"Moving  Region  6  toward  a  successful  transition  to  the  21st 
Century  is  a  top  priority." 


Region  6  covers  about  1.1  million  Department  of  Defense  (DoD)  beneficiaries  and 
oversees  19  military  medical  treatment  facilities.  These  clinics  and  hospitals  number  14 
Air  Force,  4  Army  and  1  Navy.  The  region  also  contains  Uniformed  Services  Treatment 
Facilities  and  several  Veteran's  Administration  facilities. 

The  diverse  facilities  in  Region  6  include  the  largest  Air  Force  medical  center,  Wilford 
Hall  Medical  Center;  the  newest,  Brooke  Army  Medical  Center;  and  the  smallest  Air 
Force  clinic,  the  70th  Medical  Squadron  at  Brooks  AFB. 

Moving  Region  6  toward  a  successful  transition  to  the  21st  Century  is  a  top  priority.  The 
TRICARE  Southwest  Lead  Agent  staff  has  developed  several  innovative  programs 
incoiporating  the  Region  6  vision.  Among  these  DoD  prototypes  are  the  Medical 
Outreach  Managed  Care  program;  TRICARE  Southwest:  A  National  Telemedicine 
Network;  and  the  TRICARE  Southwest  Managed  Care  University. 

The  Medical  Outreach  Managed  Care  program  is  a 
demonstration  project  designed  to  evaluate  the  concept  of 
using  operational  support  aircraft,  such  as  a  C-21  Learjet, 
to  transport  medical  teams  to  underserved  clinics  and 
hospitals  within  the  region.  Medical  Outreach  is  not  a  new 
concept;  in  its  simplest  form  it  is  an  example  of  a  "1990s 
house  call,"  taking  the  provider  to  the  patient  rather  than 
requiring  the  patient  to  come  to  the  provider. 

Several  of  the  19  military  bases  and  posts  in  Region  6  are 
in  large  metropolitan  areas  like  San  Antonio,  while  others 
are  in  sparsely  populated  areas  like  Del  Rio,  Texas  or 
Altus,  Oklahoma.  Because  some  of  these  installations  have 
large  medical  centers  and  others  have  small  clinics, 
providing  the  maximum  range  of  care  at  every  facility 
within  the  region  is  a  challenge.  The  solution  lies  in 
providing  an  efficient  alternative  means  of  specialty  care 
delivery  to  populations  with  limited  specialty  availability.  The  Medical  Outreach 
Managed  Care  program  offers  that  advantage:  the  primary  goal  is  a  more  equitable, 
cost-effective  health  care  benefit  throughout  the  region. 

For  many  years  the  military  has  sent  its  health  care  providers  to  other  locations  to 
support  smaller  facilities  in  out  -of-area  locations,  which  has  worked  well.  However, 
travel  time  translates  to  lost  provider  hours  and  lost  appointments.  An  alternative  has 
been  to  ask  the  patient  to  travel  to  the  provider.  This  alternative  also  works  well.  The 
cost?  Many  hours  of  lost  duty  time,  lost  wages,  time  away  from  the  family  and 
additional  travel  expenses.  These  traditional  methods,  though  status  quo  for  many  years, 
are  really  win/lose  opportunities  which  present  dilemmas  for  either  the  patient  or  the 
provider. 

This  Medical  Outreach  Managed  Care  initiative  has  already  proven  to  be  successful! 
Between  December,  1994  and  April,  1996,  the  C-21  crews  flew  108  missions  in  Region 
6  and  providers  saw  5,919  patients.  By  taking  the  providers  to  the  patients,  7,189  active 
duty  days  were  saved.  Total  costs  avoided  in  this  time  period  were  over  $377,285. 

Another  version  of  managed  care  outreach  is  the  Thursday  Hospital  program.  The 
Thursday  Hospital  concept  takes  ambulatory  surgery  teams  to  downsized  hospitals  in 
the  region  to  perform  procedures  on  site.  The  teams  rotate  between  remote  facilities 
each  day  of  the  week.  To  date,  Dyess  AFB,  Laughlin  AFB  and  Corpus  Christi  NAS  are 
participating  in  the  Thursday  Hospital  program  and  have  avoided  over  $637,850  in 
costs. 
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The  second  major  initiative  is  the  TRICARE  Southwest  National  Telemedicine 
Network.  The  term  "telemedicine'’  is  an  umbrella  term  which  includes  care  provided 
through  telecommunications  technology  in 
the  form  of  systems  such  as  teleconsulting, 
teleradiology  and  telepathology.  This 
video-teleconferencing-based  network  for 
Region  6  supports  the  development  and 
delivery  of  health  care  over  long  distances, 
linking  military  bases  in  a  regional 
communications  infrastructure. 

The  benefits  of  the  new  telemedicine 
project  are  numerous.  First,  telemedicine 
will  improve  beneficiary  access  to 
referrals.  Second,  both  beneficiary  and  provider  satisfaction  will  increase  due  to  less 
traveling  for  the  patient  to  a  specialist  or  the  specialist  to  a  remote  site.  Additionally,  the 
family  practice  physician  will  maintain  control  of  the  patient  and  thus  gain  knowledge 
of  more  complex  medical  problems  and  improve  continuity  of  care.  A  third  benefit  is  to 
prepare  providers  for  support  of  deployed  forces  via  teleconsulting.  Fourth,  the  program 
will  be  cost-effective.  Finally,  the  telemedicine  program  will  integrate  the  regional 

referral  process  and  facilitate  cross-service 
referrals. 


Telemedicine  includes  an  interactive  video 
system  integrated  with  biomedical 
telemetry.  It  allows  a  physician  at  a 
specialty  medical  complex  or  teaching 
hospital  to  examine  and  treat  patients  at 
multiple  satellite  locations  such  as  rural 
hospitals  and  clinics.  A  number  of 
diagnostic  devices  are  integrated  into  the 
video  system  based  on  the  requirements  of 

the  remote  medical  facility. 

The  remotely  controlled  examination  camera  has  a  powerful  zoom-focus  capability 
which  allows  a  dermatologist  to  examine  small  details  of  a  patient's  skin.  An  electronic 
stethoscope,  in  conjunction  with  real-time  digital  transmission  of  an  EKG  and 
echocardiogram,  permits  a  cardiologist  to  do  a  complete  cardiology  examination. 
Specific  camera  adapters  and  resolution  capabilities  enhanced  by  remote-controlled 
optics  provide  an  ophthalmologist  a  clear  view  of  the  retina  of  a  patient  at  the  referring 
site.  A  pathologist  using  the  telemicroscopic  adapter  can  examine  a  frozen  section  or 
bone  marrow  slide.  A  document  camera  provided  with  the  newest  teleradiology  system 
will  also  allow  consulting  physicians  to  review  x-ray  films. 


The  TRICARE  Southwest  National  Telemedicine  Network  was  one  of  the  first  DoD 
telemedicine  projects  to  be  approved  by  the  DoD  MilitaryHealth  Services  System 
(MHSS)  Proponent  Committee.  Since  a 
regional  telemedicine  network  could 
potentially  avoid  over  $1  million  in  costs 
annually  from  reduction  in  travel  and 
CHAMPUS  costs  throughout  the  remote 
locations  in  Region  6,  a  real  potential  exists 
for  a  payback  of  less  than  three  years  for 
the  telemedicine  project. 


The  Region  6  Lead  Agent  staff  is  also 
spearheading  another  DoD  prototype, 

"TRICARE  Southwest  Managed  Care 
University."  This  video  teleconferencing  network  (VTCN),  or  "virtual"  university, 
provides  continuing  executive  skills  education  for  MTFs  in  the  region  via  VTCN.  The 
curriculum  is  based  on  current  industry  practices  and  ongoing  developments  in 
knowledge  and  skills  required  for  success  in  an  environment  which  is  rapidly  changing 
from  the  traditional  military  medicine  paradigm  to  a  managed  care  environment.  The 
curriculum  is  also  based  on  the  unique  requirements  of  the  region's  military  installations 
and  the  TRICARE  program. 
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Region  6  relies  heavily  on  course  material  already  available  or  under  development  from 
existing  Air  Force,  Navy,  Army  and  Uniformed  Services  University  of  the  Health 
Sciences  sources.  Additional  course  material  has  been  provided  by  sources  in  industry 
and  academia,  such  as  the  U.S.  Army-Baylor  Graduate  Program  in  Health  Care 
Administration,  Ft.  Sam  Houston,  San  Antonio,  Texas;  and  the  School  of  Health  Care 
Sciences,  Sheppard  AFB,  Wichita  Falls,  Texas. 

The  executive  skills  program  has  established  VTCN  capability  at  the  Lead  Agent  office 
and  all  19  regional  clinics  and  hospitals,  as  well  as  communication  links  to  the  principal 
curriculum  developers.  Course  material  will  be  presented  in  a  video  seminar  format.  An 
estimated  30  course  hours  per  year  will  be  provided  to  these  20  locations  each  year. 

"The  Region  6  Lead  Agent  staff  is  committed...to 
TRICARE's  success..." 


Region  6  is  not  only  involved  in  many  innovative  programs.  The  region  also  strives  to 
blur  the  lines  between  the  services,  as  well  as  optimize  resources,  by  providing 
specialists  and  support  staff  from  WHMC  and  BAMC  to  other  Region  6  facilities  such 
as  Ft  Hood,  Ft  Polk,  and  the  Naval  Hospital,  Corpus  Christi . 

As  the  Air  Force,  Army  and  Navy  work 
together  in  Region  6  toward  a  successful 
transition  to  TRICARE,  the  Lead  Agent  is 
utilizing  tools  such  as  the  Health 
Enrollment  Assessment  Review  (HEAR), 
the  Health  Care  Information  Line 
(HCIL),  a  Mail-Order  Pharmacy  benefit 
and  the  Health  Plan  Employer  Data  and 
Information  Set  (HEDIS). 

During  enrollment  to  TRICARE  Prime, 
each  enrollee  over  17  years  old  will  be 
asked  to  complete  a  HEAR  survey.  The  HEAR  is  designed  to  identify  disease  risk 
factors,  chronic  disease  history,  currency  of  preventive  service  screenings  and  prior 
utilization  patterns  for  the  enrollee.  The  survey's  primary  purpose  is  to  identify  the 
health  status  of  the  individual  upon  enrollment.  This  tool  will  help  providers  and 
beneficiaries  shift  from  an  individual  episodic  health  care  model  to  a  population-based, 
prevention-oriented  model  of  health  care. 

Several  reports  will  be  generated  from  the  HEAR  data.  The  patient  will  receive  a 
concise  report  which  addresses  his/her  currency  for  age- appropriate  preventive 
screening  tests,  modifiable  health  risk  factors  and  chronic  disease  history. 

The  primary  care  manager  (PCM)  will  receive  an  individual  patient  report  which 
addresses  similar  information  as  the  patient  report,  but  also  addresses  such  areas  as  prior 
utilization  patterns,  prescription  medication  use  and  a 
prediction  of  the  level  of  care  needed  for  the  patient. 


Additionally,  provider  panel  reports  will  be  generated 
which  address  characteristics  of  the  patient  population 
assigned  to  that  provider.  Similar  reports  can  be 
generated  for  provider  groups,  MTFs,  catchment  areas, 
etc.  Ad  hoc  reports  can  be  generated  which  can  identify 
the  patients’  currency  of  clinical  preventive  services, 
health  risk  factors,  chronic  diseases  and  who  are  potential 
candidates  for  utilization/case  management  at  the 
regional,  MTF  and  PCM  levels. 

Beneficiaries  in  Region  6  also  have  access  to  the  HCIL-a 
24-hour  phone  service  which  provides  answers  to 
hundreds  of  health  questions.  By  calling  a  toll-free 
number,  beneficiaries  may  either  speak  to  a  Personal 
Health  Advisor  (a  registered  nurse)  for  help  in  evaluating  symptoms  for  themselves  or  a 
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family  member,  or  listen  to  over  400  recorded  messages  about  a  variety  of  health  topics 
through  the  Audio  Health  Library. 

The  Mail-Order  Pharmacy  benefit  is  included  in  the  Region  6  TRICARE  contract  as  a 
convenience  for  CHAMPUS-eligible  beneficiaries.  The  Mail-Order  option  offers  a  way 
to  order  maintenance  medications  at  a  lower  co-pay  than  at  a  TRICARE  network 
pharmacy.  The  Mail-Order  Pharmacy  benefit  is  also  available  to  Medicare-eligible 
beneficiaries  in  Base  Realignment  and  Closure  (BRAC)  sites. 

Since  Region  6  will  be  in  competition  with  and  compared  to  other  managed  care 
organizations,  HEDIS  provides  a  common  basis  by  which  to  make  those  comparisons. 

Generally  speaking,  the  major  players  in  the  managed 
care  industry  use  the  HEDIS  as  the  basis  for  those 
comparisons. 

The  HEDIS  performance  measures  are  the  result  of  a 
collaborative  effort  between  The  HMO  Group,  the 
National  Committee  on  Quality  Assurance  and  the 
Performance  Assessment  Committee.  The  HEDIS  will 
cover  65  individual  measures  in  five  major  areas  of 
evaluation:  Quality,  Access  and  Patient  Satisfaction, 
Membership  and  Utilization,  Finance,  and  Descriptive 
Information  on  flealth  Plan  Management. 

The  Region  6  Lead  Agent  staff  is  committed  not  only  to 
TRICARE's  success,  but  also  to  the  region's  success  in  a 
rapidly  changing  health  care  environment.  The  staff 
continues  to  look  at  other  regions'  lessons  learned,  while 
analyzing  and 

beneficiary  population. 

The  combination  of  a  hand-picked 
tri-service  team,  excellent  information  flow 
and  customer- oriented  programs  is 
win-win-win  for  DoD,  Region  6,  and  most 
important,  for  the  beneficiaries. 
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TRICARE  Southwest  is  located  at  7800  IH-IO  West  Suite  400,  San  Antonio,  TX  78230- 
4750.  The  point  of  contact  for  telemedicine  is  Capt.  Linda  Eaton  at  (210)  678-3217. 

To  finance  its  work  in  telemedicine,  TRICARE  Southwest  has  received  54,500,000  from 
the  Department  of  Defense  (DoD). 


TRICARE  Southwest  telemedicine  activities  involve  34  facilities.  Clinical  services 
provided  include  nursing,  specialties,  general  medicine/primary  care,  and  general 
surgery.  Specialty  services  provided  include  cardiology,  dermatology  ,  emergency 
medicine,  endocrinology,  gastroenterology',  geriatrics,  gynecology,  hematology,  infectious 
disease,  nephrology,  neurology,  obstetrics,  oncology,  ophthalmology,  orthopedics, 
otolaryngology,  pathology,  pediatrics,  physical  medicine,  primary  care,  pulmonology, 
radiology,  rheumatology,  and  urology. 
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Primary  Organization 

Participating  Organizations 

Networks 

Projects 

Facilities 


Primary  Organization  Information 

Return  to  top  of  page 

Primary  organization  description: 

A  local-government  organization 
Address: 

DoD  Region  VI  Lead  Agent  Office 
7800  IH-10  West  Suite  400 
San  Antonio,  TX  78230-4750 
Point  of  contact: 

Capt.  Linda  Eaton 
Phone:  (210)678-3217 
Fax:  (210)  678-3222 
E-mail:  Not  available 


Participating  Organizations 

Return  to  top  of  page 

Wilford  Hall  Medical  Center 
Brooke  AMC 
Randolph  Clinic 
Kelly  Clinic 
Brooks  Clinic 

Corpus  Cristi  NAS  Hospital 

Branch  Clinic  Ingleside 

Branch  Clinic  Kingsville 

Laughlin  Hospital 

Goodfellow  Clinic 

Darnall  Army  Community  Hospital 

Dyess  Hospital 
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Reese  Clinic 

Sheppard  Hospital 

School  of  Health  Care  Sciences 

Reynolds  Army  Community  Hospital 

Altus  Hospital 

Tinker  Hospital 

Vance  Clinic 

Little  Rock  Hospital 

Barksdale  Hospital 

Bayne-Jones  Hospital 


Networks 

Return  to  top  of  page 

For  this  initiative,  the  sole  network  is  equivalent  to  the  project.  Therefore,  the  network 
information  can  be  found  in  the  "Projects  section  of  this  summary'. 


Projects 

Return  to  top  of  page 

•Region  VI  Telemedicine  Pilot  Project 

PROJECT  FUNDING  SOURCES 

Department  of  Defense  (DoD) 

Point  of  contact: 

None 

Phone:  Not  available 
Fax:  Not  available 
E-mail:  Not  available 
Funding  award: 

Start  date:  Ol-Oct-95 
End  date:  30-Sep-96 
Total  award:  $2, 500, 000 

PROJECT  OBJECTIVES 

Rank  of  objectives  (in  order  of  importance  with  1  being  most  important  and  9  being  least 
important): 

None  reported 

Approach  to  accomplish  these  objectives: 

Not  reported 

Total  target  population  in  the  service  area: 

Not  reported 

PROJECT  FUNCTIONS 
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PROJECT  COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY 
UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

SATISFACTION  AND  DATA  COLLECTED 

Information  collected  regarding  satisfaction; 

Not  reported 

REPORTING  AND  OTHER  DATA  ISSUES 

Uses  of  evaluation  data: 

Not  reported  if  statistical  analyses  will  be  performed  on  evaluation  data. 
Not  reported  if  evaluation  data  is  stored  electronically. 

Not  reported  if  evaluation  data  is  available  to  external  researchers. 

PROJECT  EXPERIENCE 

Unique  qualities: 

Not  reported 
Lessons  learned: 

Not  reported 

Objectives  and  how  they  are  being  met  (in  order  of  importance  with  1  being  most 
important  and  9  being  least  important): 

Assessment  of  objectives  have  not  been  provided 


•Region  VI  Telepathology  Network 

PROJECT  FUNDING  SOURCES 

Department  of  Defense  (DoD) 

Point  of  contact:  None 
Funding  award: 

Start  date:  Ol-Apr-96 
End  date:  Ol-Apr-96 
Total  award:  $500,000 

PROJECT  OBJECTIVES 

Rank  of  objectives  (in  order  of  importance  with  1  being  most  important  and  9  being  least 
important): 

None  reported 

Approach  to  accomplish  these  objectives: 

Not  reported 

Total  target  population  in  the  service  area: 

Not  reported 
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PROJECT  FUNCTIONS 

PROJECT  COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY 
UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

SATISFACTION  AND  DATA  COLLECTED 

Information  collected  regarding  satisfaction: 

Not  reported 

REPORTING  AND  OTHER  DATA  ISSUES 

Uses  of  evaluation  data: 

Not  reported  if  statistical  analyses  will  be  performed  on  evaluation  data. 
Not  reported  if  evaluation  data  is  stored  electronically. 

Not  reported  if  evaluation  data  is  available  to  external  researchers. 

PROJECT  EXPERIENCE 

Unique  qualities: 

Not  reported 
Lessons  learned: 

Not  reported 

Objectives  and  how  they  are  being  met  (in  order  of  importance  with  1  being  most 
important  and  9  being  least  important): 

Assessment  of  objectives  have  not  been  provided 


•TRICARE  Southwest  Managed  Care  University 
PROJECT  FUNDING  SOURCES 
Department  of  Defense  (DoD) 


Point  of  contact: 

None 

Phone:  Not  available 
Fax:  Not  available 
E-mail:  Not  available 
Funding  aw'ard: 

Start  date:  Ol-Oct-95 
End  date:  30-Sep-96 
Total  award:  SI, 500, 000 

PROJECT  OBJECTIVES 
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Rank  of  objectives  (in  order  of  importance  with  1  being  most  important  and  9  being  least 
important):  fe 

None  reported 

Approach  to  accomplish  these  objectives: 

Not  reported 

Total  target  population  in  the  service  area: 

Not  reported 

PROJECT  FUNCTIONS 

PROJECT  COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY 
UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

SATISFACTION  AND  DATA  COLLECTED 

Information  collected  regarding  satisfaction: 

Not  reported 

REPORTING  AND  OTHER  DATA  ISSUES 

Uses  of  evaluation  data: 

Not  reported  if  statistical  analyses  will  be  performed  on  evaluation  data. 

Not  reported  if  evaluation  data  is  stored  electronically. 

Not  reported  if  evaluation  data  is  available  to  external  researchers. 

PROJECT  EXPERIENCE 

Unique  qualities: 

Not  reported 
Lessons  learned: 

Not  reported 

Objectives  and  how  they  are  being  met  (in  order  of  importance  with  1  being  most 
important  and  9  being  least  important): 

Assessment  of  objectives  have  not  been  provided 


Facilities  Providing  Telemedicine  Under  the  Direction  of 
TRICARE  Southwest 

Return  to  top  of  page 

•TRICARE  Southwest-  Dod  Lead  Agent  Office 

(Project:  Region  VI  Telemedicine  Pilot  Project) 
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(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 
Specific  information  regarding  this  facility  has  not  been  reported. 


•Wilford  Hall  Medical  Center 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Facility  description: 

Acute  Care  Hospital  -  Outpatient 
Address  (described  as  urban): 

LACKLAND  AFB 
San  Antonio,  TX  78236 
Patient  volume: 

Number  of  (hospital)  beds:  747 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Regularly  scheduled  clinics 
Facility'  availability: 

Regularly  available  on  specific  days  or  times 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY 
UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

PARTICIPATING  CARE  PROVIDERS 

Physicians 
Physician  Assistants 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Bandwidth  capacity: 

Full  T1  or  DS-1 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Stored  and  forwarded  data/image  transfer: 
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Still  images  for  later  review 
Video  clips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 
Network  architecture: 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 
Types  of  equipment  used: 

Multi-media 

CLINICAL  SERVICES  AND  SPECIALTIES 

Consultation  reporting  period:  1st  quarter  of  1996 
Clinical  services: 

Specialty 

General  medicine/primary  care 
General  surgery 
Summary  of  clinical  specialties: 

Dermatology 

Orthopedics 

Obstetrics 

Gynecology 

Pediatrics 

Neurology 

Cardioliogy 

ENT 

Ophthalmology 

TELEMEDICINE  PERIPHERALS  USED 

Document  camera 
Electronic  stethoscope 
ENT  scope 
Microscope 
Ophthalmoscope 
Computed  Radiography 


•Brooke  AMC 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Facility  description: 

Acute  Care  Hospital  -  Outpatient 
Acute  Care  Hospital  -  Inpatient 
Acute  Care  Hospital  -  Outpatient 
Community  Health  Center 
Dental 
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Physician  Office 

Address  (described  as  urban): 

FORT  SAM  HOUSTON 
San  Antonio,  TX  78234-6200 
Patient  volume: 

Number  of  (hospital)  beds:  458 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

As  requested  (ad  hoc) 

Regularly  scheduled  clinics 
Emergency 
Facility  availability: 

Regularly  available  on  specific  days  or  times 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY 
UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

PARTICIPATING  CARE  PROVIDERS 

Physicians 
Physician  Assistants 
Certified  Nurse  Mid-wives 
Nurse  Practitoners 
Nurses 

Clinical  Nurse  Specialists 
Physical  Therapists 
Occupational  Therapists 
Speech  Therapists 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Bandwidth  capacity: 

Full  T1  or  DS-1 

Dedicated  fiberoptic  intrafacility 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Still  images  with  2-way  audio 
Video  clips  with  2-way  audio 
Stored  and  forwarded  data/image  transfer: 

Video  clips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 

Still  images  for  later  review 
Network  architecture: 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 

Macintosh 
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Types  of  equipment  used: 

Multi-media 

Dedicated  radiology  workstation 

CLINICAL  SERVICES  AND  SPECIALTIES 

Consultation  reporting  period:2nd  quarter  of  1996 
Clinical  services: 

Nursing 

Specialty 

General  medicine/primary  care 
General  surgery 
Summary  of  clinical  specialties: 

TELEMEDICINE  PERIPHERALS  USED 

Document  camera 
Electronic  stethoscope 
ENT  scope 
Microscope 
Ophthalmoscope 
Computed  Radiography 


•Randolph  Clinic 

(Project:  TRICARE  Southwest  Managed  Care  University) 


Address: 

221  3rd  Street  West 
Randolph  AFB,  TX  78150 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 
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TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Kelly  Clinic 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

204  Wagner  Drive,  Bldg.  1740 
Kelly  AFB,  TX  78241 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Brooks  Clinic 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

8005  Lindbergh  Drive 
Brooks  AFB,  TX  78235 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
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How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported. 


•Corpus  Christi  NAS  Hospital 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Naval  Hospital 
Corpus  Christi,  TX  78419 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 
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Bandwidth  capacity: 

Full  T1  or  DS-1 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Stored  and  forwarded  data/image  transfer: 

Still  images  for  later  review 
Video  clips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 
Network  architecture: 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 
Types  of  equipment  used: 

Multi-media 

CLINICAL  SERVICES  AND  SPECIALTIES 

Primary  Care  Services 

TELEMEDICINE  PERIPHERALS  USED 

Document  Camera 
Electronic  Stethoscope 
ENT  Scope 
Ophthalmascope 
Microscope 
Slit  Lamp 


•Branch  Clinic  Ingleside 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

7500  EAST  HELLMAN  AVENUE 
ROSEMEAD,  CA  91770 
Patient  volume: 

Number  of  (hospital)  beds:  126 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
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Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 
Technology'  and  Communications  not  reported. 
CLINICAL  SERVICES  AND  SPECIALTIES 
None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Branch  Clinic  Kingsville 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Naval  Air  Station 
Kingsville,  TX  78363 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 
Not  reported 
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•Laughlin  Hospital 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

ddress: 

590  Mitchell  Boulevard 
Laughlin  AFB,  TX  78843 
Patient  volume: 

Number  of  (hospital)  beds:  7 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility'  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Bandwidth  capacity: 

Full  T1  or  DS-1 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Stored  and  forwarded  data/image  transfer: 

Still  images  for  later  review 
Video  clips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 
Network  architecture: 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 
Types  of  equipment  used; 

Multi-media 


CLINICAL  SERVICES  AND  SPECIALTIES 

Primary'  Care  Services 

TELEMEDICINE  PERIPHERALS  USED 

Document  Camera 
Electronic  Stethoscope 
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ENT  Scope 

Ophthalmascope 

Microscope 

Computed  Radiography 


•Goodfellow  Clinic 


(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

271  Fort  Richardson  Avenue 
Goodfellow  AFB,  TX  76908 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 


Bandwidth  capacity: 

Full  T1  or  DS-1 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Stored  and  forwarded  data/image  transfer: 
Still  images  for  later  review 
Video  clips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 
Network  architecture: 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 
Types  of  equipment  used: 

Multi-media 


CLINICAL  SERVICES  AND  SPECIALTIES 


Primary  Care  Services 

TELEMEDICINE  PERIPHERALS  USED 

Document  Camera 
Electronic  Stethoscope 
ENT  Scope 
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Ophthalmaseope 

Microscope 

Computed  Radiography 


•Darnall  Army  Community  Hospital  (Ft.  Hood) 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Fort  Hood 

Fort  Hood,  TX  76544 
Patient  volume: 

Number  of  (hospital)  beds:  236 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 


A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Bandwidth  capacity: 

Full  T1  or  DS-1 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Stored  and  forwarded  data/image  transfer: 

Still  images  for  later  review 
Video  elips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 
Network  architecture: 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 
Types  of  equipment  used: 

Multi-media 


CLINICAL  SERVICES  AND  SPECIALTIES 
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Consultation  reporting  period:  1st  quarter  of  1996 
Clinical  services: 

Specialty 

General  medicine/primary  care 
General  surgery 
Summary  of  clinical  specialties: 

Dermatology 

Orthopedies 

Obstetrics 

Gynecology' 

Neurology' 

Cardioliogy 

Ophthalmology 

TELEMEDICINE  PERIPHERALS  USED 

Document  camera 
Electronic  stethoscope 
ENT  scope 
Microscope 
Ophthalmoscope 
Computed  Radiography 


•Dyess  Hospital 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

697  Hospital  Road 
Dyess  AFB,  TX  79563 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Bandwidth  capacity: 

Full  T1  or  DS-1 
Transmission  medium: 

Lan  -  Ethernet 

WAN  -  Point  to  Point,  Dedicated  T1 
Real-time  data/image  transfer: 

Full  motion  interactive  video 
Stored  and  forwarded  data/image  transfer: 

Still  images  for  later  review 
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Video  clips  for  later  review 
Audio  clips  for  later  review 
Text  e-mail 
Network  architecture; 

Client-server 

Computer  operating  system  (OS): 

DOS/Windows 
Types  of  equipment  used: 

Multi-media 

CLINICAL  SERVICES  AND  SPECIALTIES 

Primary  Care  Services 

TELEMEDICINE  PERIPHERALS  USED 

Document  Camera 
Electronic  Stethoscope 
ENT  Scope 
Ophthalmascope 
Microscope 

Computed  Radiography 


•Reese  Clinic  (BRAC) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

250  13th  Street 
Reese  AFB,  TX  79489 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 

A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 


None  reported 
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TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Sheppard  Hospital 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

6501  North  Charles  Street 
Baltimore,  MD  21204 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•School  of  Health  Care  Sciences 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Sheppard  Air  Force  Base 

Specific  information  regarding  this  facility  has  not  been  reported. 
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•Reynolds  Army  Community  Hospital 

(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

4700  Hartell  Boulevard 
Fort  Sill,  OK  73503 
Patient  volume: 

Number  of  (hospital)  beds:  106 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability  : 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Altus  Hospital 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Altus  AFB 
Altus,  OK  73525 
Patient  volume: 

Number  of  (hospital)  beds:  28 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 
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COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Tinker  Hospital 

(Project:  TRICARE  Southwest  Managed  Care  University) 


Address: 

5700  Arnold  Street 
Tinker  AFB,  OK  73145 
Patient  volume: 

Number  of  (hospital)  beds:  25 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 


Technology  and  Communications  not  reported. 
CLINICAL  SERVICES  AND  SPECIALTIES 
None  reported 

TELEMEDICINE  PERIPHERALS  USED 
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Not  reported 


•Vance  Clinic 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Complete  address  unavailable 
Patient  volume: 

Number  of  (hospital)  beds:  Not  reported  or  applicable 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Digital  Radiography 


•Little  Rock  Hospital 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Little  Rock  AFB 
Jacksonville,  AR  72099 
Patient  volume: 

Number  of  (hospital)  beds:  24 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 
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COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 


•Barksdale  Hospital 


(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Barksdale  AFB 
Shreveport,  LA  71110 
Patient  volume: 

Number  of  (hospital)  beds:  25 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility'  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 
Technology  and  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 
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Not  reported 


•Bayne-Jones  Army  Community  Hospital 

(Project:  Region  VI  Telemedicine  Pilot  Project) 

(Project:  Region  VI  Telepathology  Network) 

(Project:  TRICARE  Southwest  Managed  Care  University) 

Address: 

Fort  Polk 

Fort  Polk,  LA  71459 
Patient  volume: 

Number  of  (hospital)  beds:  81 
Number  of  clinic  visits:  Not  reported  or  applicable 
How  consults  are  scheduled: 

Not  reported 
Facility  availability: 

Not  reported 

COSTS  ASSOCIATED  WITH  TELEMEDICINE  (ACCURACY  UNKNOWN) 
A  quick  link  to  Grant  Awards  by  Agency 
Not  reported 

TECHNOLOGY  AND  COMMUNICATIONS  USED 

Technology  amd  Communications  not  reported. 

CLINICAL  SERVICES  AND  SPECIALTIES 

None  reported 

TELEMEDICINE  PERIPHERALS  USED 

Not  reported 
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TRICARE  Southwest-  Dod  Lead  Agent  Office 

(Project:  Region  VI  Telemedicine  Pilot  Project) 
(Project:  Region  VI  Telepathology  Network) 
(Project:  TRICARE  Southwest  Managed  Care  University) 
Specific  information  regarding  this  facility  has  not  been  reported. 

fH  6ot*t*e  Federal  Telemedicine  Bateway  Meat 


T op  I  Comments  I  Help  I  Search 


Updated":  6/18/1)7 


httD:/7www.tm2atewav.org/eatewav/apencies;/HnH/t 4/Hod  1 4fl  html 


4/16/Q8 


APPENDIX  K 

BAMC/GPRMC  REVIEW  OF  TELEMEDICINE  AND  VTC 
EQUIPMENT  AND  INVESTMENT  COSTS 


MCHE  -  IR  (11-7) 


15  January  1998 


MEMORANDUM  FOR  Chairman,  T-MedA/TC  Working  Group 

SUBJECT:  Review  of  Telemedicine  (T-Med)  and  Videoteleconferencing  (VTC) 
Equipment  and  Investment  Costs,  Project  97-22 

1.  INTRODUCTION. 

a.  Background.  The  initial  purchase  order  for  Telecommunication  Services  at 
BAMC,  dated  28  June  1995,  was  for  $1,116,226.00.  Ten  Telemedicine  Systems,  one 
Videoconferencing  System,  and  Communication  Systems  Hardware  were  delivered  and 
installed  at  BAMC,  November  and  December  1995.  Due  to  various  problems,  such  as 
the  move  to  the  new  BAMC  and  connectivity,  most  of  the  systems  from  the  initial 
purchase  were  not  used  as  envisioned.  Six  Global  Med  systems  purchased  through  the 
Lead  Agent  were  later  installed  at  various  departments  in  BAMC.  The  BAMC  Property 
Book  Office  inventoried  the  systems,  assigned  them  Materiel  Management  Control 
Numbers  (MMCN)  and  estimated  their  costs. 

b.  Objective.  To  inventory  Telemedicine  and  Videoconferencing  equipment  and 
determine  total  investment  costs. 


2.  SOURCE/SCOPE.  The  review  was  conducted  for  the  most  part  according  to 
generally  accepted  government  auditing  standards.  The  scope  was  limited  to  actual 
inventory  of  equipment  by  the  Property  Book  Office  and  Internal  Review,  and 
examination  of  supporting  documents,  such  as  purchase  requests,  purchase  orders, 
Military  interdepartmental  Purchase  Requests  (MIPR)  and  logs  during  September  1995 
-  December  1997.  Field  work  was  conducted  at  various  departments  in  BAMC  and 
HQRMC  during  July  1997  -  December  1997. 


3.  RESULTS. 

a.  Inventory.  There  was  no  tracking  system  in  place  to  accurately  account  for  all 
T-MedA/TC  equipment  costs,  installations,  upgrades  and  maintenance  since  its 
inception  at  BAMC  ini 995.  As  a  result,  the  enclosed  inventory  listing  is 
presented  to  the  working  group  to  use  as  a  baseline  in  establishing  proper 
accountability  forT-med/VTC  equipment.  The  audit  identified  23  T-Med  and 
VTCs  at  BAMC,  Wilford  Hall  Medical  Center  (WHMC)  and  HQ,  GPRMC  which 
are  either  on  the  BAMC  property  book  or  in  the  process  of  being  added.  The 
following  observations  were  also  noted: 


MCHE  -  IR  (11-7) 


15  January  1998 


SUBJECTL  Review  of  Telemedicine  (T-Med)  and  Videoteleconferencing  (VTC) 
equipment  and  Investment  Costs,  Project  97-22 

(1)  One  system  still  in  the  BAMC  warehouse  since  1995  in  open 
freight  boxes  appeared  to  have  missing  components. 

(2)  A  review  of  the  initial  1995  purchase  order  showed  a  VTC 
system  for  the  Commander  and  Communications  Systems  Hardware  that  we  were 
not  able  to  account  for  during  the  inventory.  The  current  Communications  System  s 
Hardware  on  the  inventory  list  was 

b.  Investment  Costs 


c. 


4.  RECOMMENDATIONS. 

5.  Auditor  Comment. 


Subject:  RE:  Minutes  of  TMed/VTC  Organizational  Meeting  22  July. 

Author:  Michael  Flahie  at  MEDCEN2_FSHTX 
Date:  7/22/97  5:42  PM 

Sirs/Ma'ams: 

Immediately  following  this  meeting,  1 LT  Bruno,  Andries  Tek  personnel,  and  I  did  a  survey  of  all  the  NEC 
equipment  at  BAMC.  I  will  summarize  the  status  of  each  unit,  and  the  action  to  be  taken  to  activate  each  unitNLT 
tomorrow  AM.  In  general,  we  have  units  where  there  are  no  drops,  and  drops  where  there  are  no  units.  Clearly,  in 
the  time  period  between  drop  installation  and  the  equipment  being  brought  online,  the  equipment  has  suffered 
random  brownian  motion. ...Two  units  where  found  to  be  inoperable-  one  with  no  video  (Codec  problem),  and  one 
with  no  power.  These  will  be  repaired  immediately.  Most  were  lacking  MMCN  barcodes.  Flahie 

- Original  Message - 

From:  LTC  Daryl  Zeigler 

Sent:  Tuesday.  July  22,  1997  04:27  PM 

To:  Dwaine  Brown:  1  LT  Sandra  Bruno;  LTC  Jean  Dailey;  Michael  Flahie;  Vicky  Hamlin;  Herbert  Jones;  Gerrie 
Natalino:  Evelyn  Vergara;  LTC  Tom  Wittman;  COL  John  Roscelli:  COL  James  Keeling;  LTC  Gary  Simmons;  LTC 
Jan  Eagan:  COT  Dena  A.  Norton;  COL  Franklin  Brooks;  Pamelia  Clement;  dgoss@io.com 

Cc:  COL  Toney  Baskin;  COL  Joseph  Gonzales;  BG  Harold  Timboe 
Subject:  Minutes  of  TMed/VTC  Organizational  Meeting  22  July. 

MCHE-PMR  22  July  1997 

I.  Meeting  called  to  order  by  chair  at  0835  in  the  Command  Conference 
Room  BAMC. 

II.  Attendance  (order  of  sign-in) 

LTC  Daryl  Zeigler,  C. Medical  Informatics  (Chairman)  6-1924 

Vicki  Hamlin  Commo  Branch.  IMD  6-3600 

Evelyn  Vergara  BAMC  Internal  Review  6-2009 

Gerrie  Natalino  Computer  Svcs  Branch,  IMD  6-3300 

Pam  Clement,  PhD  Dept.Psychology  6-5779 

COL  Franklin  Brooks  C. Dept.Psychology  6-1600 

I  LT  Sandra  Bruno  Dept  of  Surgery  6-5414 

COL  John  Roscelli  C.Dept.Pediatrics  292-5097 

COL  James  Keeling  C. Dept. Dermatology  6-4408 

LTC  Jean  Dailey  Region  VI  Lead  Agency  292-3217 

Fred  Chriswell  Andries  Tek.  Chief  Engineer  800-395-1331 

Dirck  Goss  Andries  Tek.  Pres/CEO  800-395-1331 

LTC  Jan  Eagan  C.Clinica!  Informatics,  DON  6-4817 

Michael  Flahie  ACS  1M,  GPRMC  6-6042 

Dwaine  Brown  HCSSA/MEDNET  265-2078 

LTC  Tom  Wittman  C.IMD.  BAMC  6-4460 

COL  Dena  Norton  DON  6- 1 89 1 

LTC  Gary  Simmons  Dept.  Radiology  6-4218 

Herbert  Jones  LOG/Property  Book  6-3132 

III.  Agenda 

A.  Clinical  Problems/Issues 

1.  COL  Berry.  C.DOM.  by  written  memorandum 

2.  COL  Roscelli  in  attendance 

3.  COL  Keeling  in  attendance 

4.  LTC  Simmons  in  attendance 

5.  COL  Norton/LTC  Eagan  in  attendance 

B.  IMD  Admin/Logistics/Internal  Review/Lead  Agent/GPRMC 


1.  Audit  of  hardware  (include  two  units  at  WHMC) 

2.  Property  Book/Hand  Receipt  to  end  using  activity 

3.  Service  contracts  status 

C.  HCSSA/Andries  Tek/GPRMC  IMD  BAMC 

1.  Connectivity  issues 

2.  Scheduling  of  VTC/T-Med  at  HCSSA  Bridge  for  >2  sites 

3.  Scheduling  of  Common  Use  Rooms  ->  BAMC  IMD 

4.  Training  of  end  users 

5.  Help  Desk  function  in  real  time  by  IMD  (6-HELP  in  planning  stage).  Goal  of  ONE  phone  number  for  end  users  to 
call  for  help,  [and  training?] 

6.  Command  influence  to  obtain  WHMC  cooperation 

IV.  Tasking 

A.  Clinical  area  problems  to  be  addressed  by  IMD/GPRMC/HCSSA  and  Andries  Tek  which  involves  hardware, 
drops  and  connectivity 

B.  Audit/property  book/hand  receipt  and  status  of  service  contracts  to  be  addressed  by 
LOG/IR/IMD/GPRMC/Andries  Tek  Lead  Agent 

C.  Scheduling  of  connectivity  via  MEDNET  by  HCSSA  and  "bridge” 

D.  Scheduling  of  VTC/T-Med  rooms  and  equipment  by  user  activity  and  by  IMD  for  common  use  rooms  including 
key  control 

E.  Training  of  end  users  will  be  coordinated  by  IMD  with  input  volunteered  by  HCSSA  and  Andries  Tek 

F.  Help  Desk  function  is  being  developed  by  IMD  with  near-term  horizon  for  implementation 

G.  LTC  Zeigler  will  brief  COL  Baskin  and  COL  Gonzales  on  meeting  and  need  for  command  influence  at  WHMC 

V.  Meeting  adjourned  at  1050  hrs. 

VI.  Next  meeting  will  be  announced  via  ccMail  which  will  be  the  primary  and  preferred  means  of  communication. 
Interim  report  on  audit  activity  will  be  submitted  NLT  7  August.  BAMC-wide  100%  inventory  starting  1 1  August 
will  aid  in  "finding"  any  "lost"  hardware.  VII.  These  are  "dynamic  minutes"  in  that  anyone  who  attended  the 
meeting  should  add  to  and  amplify  any  aspect  of  the  agenda  and  taskings.  Please,  however,  reply  to  ALL 
ADDRESSEES  so  that  all  will  be  able  to  respond. 

Daryl  N.  Zeigler 
LTC.  MC 

Chief,  Medical  Informatics.  BAMC 


From:  Zeigler.  LTC  Daryl 

Sent:  Friday.  August  15,  1997  4:48  PM 

To:  Brown.  D:  Brooks.  COL  Franklin  ;  LTC  Jean  Dailey  at  Internet-Mail: 

Wittman,  LTC  Tom  :  BAMC.  Chief  Resident  DOM  ;  Bruno,  1LT  Sandra  ;  Bulgrin,  Jim  ; 

Hamlin.  Vicky  :  Vergara.  Evelyn  ;  Jones,  Herbert ;  Roscelli,  COL  John  ;  Keeling, 

COL  James :  Berry.  COL  Michael :  Thompson,  COL  Ian  ;  Natalino,  Gerrie  ;  Trawick, 

Kenneth  :  dgoss@io.com:  Eagan.  LTC  Jan  ;  Norton,  COL  Dena  A. 

Cc:  Gonzales.  COL  Joseph  :  Baskin,  COL  Toney  ;  Timboe,  BG  Harold 

Subject:  Minutes  of  the  2nd  T-Med/VTC  Working  Group,  14  Aug  97  Minutes  of  the  T-Med/VTC  Working  Group 

A.  The  group's  second  meeting  took  place  on  14  August  from  0830-0930  in  the  Command  Conference  Room. 

B.  Attendance: 

COL  Franklin  Brooks.  C,  Dept.  Psychology 

LTC  Jean  Dailey.  Lead  Agency  Representative 

LTC  Tom  Wittman.  C.  IMD 

CPT  Bill  Dixon.  Chief  Resident,  Dept,  of  Medicine 

1LT  Sandra  Bruno  (Laska).  Admin.  Dept,  of  Surgery 

Mr.  Jim  Bulgrin,  Cardiology  Service 

Ms  Vicky  Hamlin.  Commo  Br.,  IMD 

Ms  Evelyn  Vergara.  BAMC  Internal  Review 

Mr.  Herbert  Jones.  Sr..  Property  Book  Officer,  LOG 

LTC  Daryl  Zeigler.  Chairman 


C.  OLD  BUSINESS: 

1 .  Follow  up  of  the  clinical  areas  represented  at  first  meeting  plus  Cardiology.  Problems  and  connectivity  issues 
were  identified  by  the  Depts.  of  Medicine,  Dermatology.  Pediatrics.  Psychology  plus  Cardiology  Service. 

a.  Report  on  measures  to  correct  meeting  #1  clinician  identified  concerns  of  reliability  (LTC  Wittman,  Ms  Hamlin) 

1)  Re:  Dept,  of  Medicine  to/from  DACH. 

DISCUSSION:  The  distance  from  DACHto  the  Primary  Care  Track  site  (TREMMIER  CLINIC)  is  over  3  miles.  The 
issue  is  audio  drop-out.  not  video  drop-out.  Cabling  is  suspect. 

CONCLUSION:  The  cabling/wiring  between  DACH  and  the  Clinic  is  not  up  to  par  for  use  in  VTC. 

ACTIONS: 

a)  Determine  the  cost  of  upgrading  and  laydown  of  cabling  plus  the  time-line  to  accomplish  this. 

b)  If  a)  will  take  more  than  2  months  to  accomplish,  temporarily  conduct  VTC  at  DACH  where  reliability  has  been 
shown. 

c)  Follow  up:  CPT  Dixon,  Ms  Hamlin,  LTC  Wittman 

d)  POC  @  Ft  Hood  in  DOM  is  Cpt  Howser  (254)634-7647. 

b.  1 LT  Bruno  reports  an  incident  in  which  between  0700-0800  on  -Tuesday  of  this  week.  Ophthalmology  Service 
was  conducting  a  three-way  VTC  with  WHMC  and  UT-Galveston. 

DISCUSSION:  At  some  point.  UTHSC-SA  audio  intruded  on  the  three-way  VTC.  How  this  happened  is  not  yet 
known. 

CONCLUSION:  It  is  obviously  an  embarassment  for  this  sort  of  thing  to  happen,  in  addition  to  the  great  annoyance 
and  disruption  it  causes. 

ACTIONS:  Ms  Hamlin  will  check  with  HCSSA/USAMISSA  for  troubleshooting  this  issue.  1  LT  Bruno  will  provide 
precise  date  and  time  for  assisting  in  assessment  of  MEDNET  LOG  files. 

c.  On  Tuesday.  12  August  at  1430,  BG  Timboe  and  a  reporter  for  the  Mercury  were  to  participate  in  a  VTC  with 
COL  Farmer.  CMDR  of  DACH.  for  the  "Hospital  Without  Walls"  follow  up  story.  All  connectivity  was  properly 
checked  out  earlier  in  the  day.  but  at  "show  time",  connectivity  with  DACH  was  nonexistent,  and  connectivity  with 


GPRMC  (Mr.  Flahie)  was  up  and  down  repeatedly.  Mr.  Flahie  reported  telephonically  and  Ms  Hamlin  at  this 
meeting  that  adjustments  of  some  sort  were  being  performed  at  HCSSA/USAMISSA  who  showed  NO 
SCHEDULED  VTC  events  on  their  "bridge”  schedule. 

CONCLUSION:  Since  BAMC  has  dial  anywhere  capability  between  it  and  one  other  site,  no  scheduling  through  the 
"bridge"  at  FICSSA/USAMISSA  is  required.  However,  communication  is  essential  to  prevent  this  major  disruption 
of  a  BAMC  mission.  The  missions  of  BAMC  take  precedence  over  scheduled,  non  emergency  work  on  any  of 
it'sIM/IT  systems. 

ACTION:  Ms  Hamlin/LTC  Wittman  have  indicated  that  before  the  end  of  FY97.  at  least  two  full  time  contract 
personnel  will  be  hired  to  handle  HELP  and  SCHEDULING  functions.  The  USAMISSA  must  CLEAR  with  BAMC 
before  any  routine  maintenance  is  to  be  performed  on  MEDNET,  etc. 

2.  Follow  up  inventory  of  equipment  and  operational  status  of  all  BAMC  units  (including  two  at  WHMC). 

DISCUSSION:  A  critical  starting  point  to  move  VTC/T-Med  forward  from  "stove  piperv"  to  an  integrated, 
comprehensive  entity  is  full  accountability  of  assets  in  all  areas.  A  three  hour  walk  about  inventory  was  conducted 
by  Mr.  Flahie,  1LT  Bruno  (Laska).  Ms.  Vergara.  LTC  Dailey,  and  Mr.  Jones  after  the  first  meeting  last  month.  Mr. 
Jones  reports  that  the  BAMC  100°o  inventory  is  underway  and  will  add  further  details  to  the  ad  hoc  inventory  just 
described. 

CONCLUSION:  A  list  has  not  yet  been  compiled  or  provided  which  comprehensively  lists  BAMC  assets  for  T- 
Med/VTC  at  BAMC  or  at  WHMC.  This  is  a  pending  action  per  Mr.  Mike  Flahie. 

ACTION:  Mr.  Flahie’s  list  to  follow  by  next  meeting. 

3.  Follow  up  for  location  of  drops  at  BAMC  and  WHMC. 

ACTION:  This  is  rolled  up  into  Mr.  Flahie's  report. 

4.  Follow  up  about  staffing  for  centralized  HELP.  SCHEDULING,  and  TRAINING. 

ACTION:  The  hiring  of  two  contract  personnel  to  full  time  T-Med/VTC  is  planned  to  handle  the  HELP  and 
SCHEDULING  functions.  Offers  from  Andries  Tech  and  Dwaine  Brown  of  HCSSA  to  help  in  the  TRAINING 
aspects  were  offered  at  last  meeting.  The  TRAINING  piece  needs  further  definition  and  delineation.  Follow  up  by 
Ms  Hamlin.  LTC  Wittman. 

D.  NEW  BUSINESS: 

1.  CPT  Dixon  reports  potential  utilization  of  VTC/T-Med  by  DOM  at  9/week  to/from  DACH. 

2.  Cardiology  Service.  Mr.  Bulgrim  representing,  requests  relocation  of  Cardiology  Conference  Room  gear  to  an 
adjacent  room  (331-5)  as  upgrade  of  existing  conferencingcapability  is  occuring.  Additional  inquiry  about 
connectivity  within  BAMC  among  other  VTC  sites  was  answeredaffirmative  by  Ms.  Hamlin  LTC  Wittman/LTC 
Zeigler,  for  POINT-TO-POINT.  ONE-TO-ONE  service  only. 

CONCLUSION:  Clinical  VTC/T-Med  need  identified. 

ACTION:  Ms.  Hamlin,  et  al  from  IMD  will  work  with  Cardiology  to  accomplish  upgrades  and  connections.  Work 
the  issue  of  how  more  than  two  sites  within  BAMC  could  be  connected.  Internal  BAMC  "bridge"? 

3.  Re:  Other  clinical  areas  not  represented  at  this  meeting.  CONCLUSION:  All  clinical  areas  must  have  input  for 
current  needs  assessment  and  formulation  of  VTC/T-Med  utilization  plans. 

ACTIONS:  1LT  Bruno  will  survey  DOS  subspecialty  clinics.  CPT  Dixon  will  survey  DOM  subspecialty  clinics. 
COL  Brooks  will  survey  Psychiatry  and  Social  Work  and  Ms  Hamlin  will  survey  all  other  separate 
Departments/Services  for  issues  of  reliability  for  VTC  in  current  use,  and  determine  need  for  VTC/T-Med  within 
each  area. 

FOLLOW  UP:  A  comprehensive  picture  of  the  clinical  areas  at  BAMC  should  emerge  by  next  month's  meeting. 

4.  Expanding  the  notion  of  a  BAMC  inventory  and  connectivity  survey  to  include  all  MTFs  in  GPRMC  to  plan  for 
greater  VTC/T-Med  connectedness  with  and  among  each  other  and  BAMC. 


DISCUSSION:  Since  connectivity  is  dependent  on  the  status  of  all  parties,  and  the  status  of  all  MTF  T-Med/VTC 
capability  is  still  largely  unknown,  a  complete  inventory  of  hardware  assets  and  drops  must  be  known  throughout 
GPRMC  and  the  city  of  San  Antonio.  Each  MTF  IMO  must  work  closely  with  the  clinical  side  to  pinpoint  location 
for  T-Med/VTC  equipment  placement  and  location  of  drops. 

CONCLUSION:  Deficient  data  on  connectivity  within  GPRMC/SATX. 

ACTION:  Mr  Flahie  has  been  in  contact  with  IMOs  throughout  GPRMC  and  the  T-Med/VTC  initiative  for 
Emergency  Departments  directed  by  BG  Tiinboe  is  now  adding  impetus.  By  next  meeting,  the  inventory  will  be 
ready  for  distribution  and  discussion. 

5.  Opening  a  dialogue  with  WHMC  in  establishing  the  military  links  for  VTC/T-Med  city  wide  with  UTHSC-SA  is 
an  urgent  issue. 

DISCUSSION:  City-wide  medical  center  T-Med/VTC  connectivity  has  been  identified  as  indispensible  by  echelons 
well  placed  at  OTSG.  UTHSC-SA  President  and  Texas  legislative  levels,  but  has  been  stymied  due  to  several 
factors.  Between  today's  meeting  and  the  first  meeting  of  this  working  group.  COL  Baskin,  LTC  Wittman,  Mr. 
Flahie  and  LTC  Zeigler  met  to  discuss  issues  with  bearing  on  our  current  lack  of  connectivity  with  WHMC. 
CONCLUSION:  Roadblocks  exist  that  shouldn't. 

ACTION:  An  issues  memorandum  will  be  prepared  for  submission  to  COL  Baskin  which  will  lead  to  command 
level  dialogue  to  ease  chronic  blocks  to  mission  accomplishment. 

6.  Meeting  adjourned  at  0030.  Next  meeting  will  take  place  on  4  September,  0830-1000  in  the  Command 
Conference  Room. 

Daryl  N.  Zeigler 
LTC,  MC 
Chairman 

Chief.  Medical  Informatics  and  Telemedicine 


Minutes  of  the  T-Med/VTC  Working  Group  4  Sept  97 

A.  The  group's  third  meeting  took  place  on  4  September  from  0830-1000  in  the  Command  Conference  Room. 

B.  Attendance: 

1.  Present 

LTC  Jean  Dailey,  Lead  Agency  Region  #6  (292-3217)  LTC  Tom  Wittman.  C,  IMD  (6-4460) 

Ms  Gerrie  Natatino,  Computer  Svc  Br.  IMD  (6-3300) 

Ms  Vicky  Hamlin,  Commo  Br..  IMD  (6-3600) 

Mr  Bob  Meints,  Lead  Agency  Region  #6  (292-3240) 

CPT  Bill  Dixon,  Chief  Resident.  Dept,  of  Medicine  (6-1414) 

Mr  Jim  Bulgrin,  Cardiology  Service  (6-2268) 

Mr  Dwaine  Brown.  USAMISSA/HCSSA  (265-2078) 

COL  Rohini  Daniels.  C,  DPALS  (6-331 1) 

Mr  Ed  Ng,  Nutrition  Care  Division  (6-3372) 

Ms  Evelyn  Vergara.  BAMC  Internal  Review  (6-2009) 

LTC  Daryl  Zeigler,  Chairman  (6-1924) 

2.  Absent 

Pam  Clement.  PhD.  Dept,  of  Psychology  (6-5779) 

COL  Franklin  Brooks.  C.  Dept,  of  Psychology  (6-1600) 

Mr  Herbert  Jones,  Sr..  Property  Book  Officer.  LOG  (6-3132) 

Mr  Mike  Fiahie.  ACS  for  IM.  GPRMC  (6-6042) 

1LT  Sandra  Bruno.  Dept,  of  Surgery  (6-5414) 

COL  John  Roscelli.  C.  Dept,  of  Pediatrics  (292-5097) 

COL  James  Keeling.  C.  Dept,  of  Dermatology  (6-4408) 

Mr  Fred  Chriswell,  Andries  Tek.  Chief  Engineer  (800-395-133 1) 

Mr  Dirck  Goss,  Andries  Tek,  Pres/CEO  (800-395-1331) 

LTC  Jan  Eagan,  C,  Clinical  Informatics,  DON  (6-4817) 

COL  Dena  Norton,  DON  (6-1891) 

LTC  Gary  Simmons.  Dept,  of  Radiology  (6-4218) 

C.  OLD  BUSINESS: 

1.  Follow  up  of  clinical  areas. 

a.  Dept,  of  Medicine  to/from  DACH. 

DISCUSSION:  The  distance  from  DACH  to  the  Primary  Care  Track  site  (TREMMIER  CLINIC  AC3)  is  over  3 
miles.  The  issue  is  audio  drop-out,  not  video  drop-out.  Cabling  was  suspect,  but  Mr  Brown  and  Ms  Hamlin  state  that 
the  manner  of  connection  between  AC3  and  DACH  is  not  optimal. 

CONCLUSION:  Connectivity  between  DACH  and  the  Tremmier  Clinic  is  not  up  to  par  for  use  in  VTC. 

ACTIONS: 

FOLLOW  UP:  CPT  Dixon.  Ms  Hamlin.  Mr  Brown 
POC  (<f?  Ft  Hood  in  DOM  is  Cpt  Howser  (254)634-7647. 

b.  Audio  intrusion  from  UTHSC-SA  on  an  Ophthalmology  Service  three-way  VTC  with  WHMC  and  UT-Gaiveston. 
DISCUSSION:  Mr  Brown  reports  investigation  of  the  problem  detected  a  hardware  problem  at  the  V-Tel  bridge  of 
UTHSC-SA.  This  is  actively  being  remedied. 


CONCLUSION:  Problem  identified. 

ACTIONS:  To  prevent  similar  problems  originating  from  his  area,  Mr  Brown  has  examined  HCSSA/USAMISSA 
bridge  operations  with  process  improvement  as  a  goal.  This  has  lead  to  designating  separate  "black  boxes"  for  T- 


Med  (patient  care)  from  VTC  (talking  heads)  use.  Access  will  be  greatly  limited  to  the  patient  care  "box".  FOLLOW 
UP:  Mr.  Brown  on  status  of  UTHSC-SA  V-Tel 

c.  Cardiology  Service.  Mr.  Bulgrim.  requested  relocation  of  Cardiology  Conference  Room  gear  to  an  adjacent  room 
(331-5)  as  upgrade  of  existing  conferencing  capability  is  occuring.  Additional  inquiry  about  connectivity  within 
BAMC  among  other  VTC  sites  was  answered  affirmative  by  Ms.  Hamlin/LTC  Wittman/LTC  Zeigler,  for  POINT- 
TO-POINT,  ONE-TO-ONE  service  only. 

CONCLUSION:  Clinical  VTC/T-Med  need  identified. 

ACTION:  Ms.  Hamlin,  et  al  from  1MD  will  work  with  Cardiology  to  accomplish  upgrades  and  connections.  Work 
the  issue  of  how  more  than  two  sites  within  BAMC  could  be  connected.  Internal  BAMC  "bridge"? 

FOLLOW  UP:  next  meeting 

d.  Re:  Other  clinical  areas  not  represented  at  any  meetings  to  date. 

DISCUSSION:  All  clinical  areas  must  have  input  for  current  needs  assessment  and  formulation  of  VTC/T-Med 
utilization  plans.  CONCLUSION:  Clinical  area  recruitment  needed. 

ACTIONS:  1LT  Bruno  will  survey  DOS  subspecialty  clinics,  CPT  Dixon  will  survey  DOM  subspecialty  clinics. 
COL  Brooks  will  survey  Psychiatry  and  Social  Work  and  Ms  Hamlin  will  survey  all  other  separate 
Departments/Services  for  issues  of  reliability  for  VTC  in  current  use,  and  determine  need  for  VTC/T-Med  within 
each  area. 

FOLLOW  UP:  A  comprehensive  picture  of  the  clinical  areas  at  BAMC  should  emerge  by  next  month's  meeting. 
FOLLOW  UP:  No  report  this  meeting  since  COL  Brooks  and  1LT  Bruno  not  present  and  Ms  Hamlin/CPT  Dixon 
did  not  report  in  interest  of  time.  Reports  due  next  meeting. 

2.  Follow  up  of  command  areas. 

a.  Problem  with  failed  VTC  between  BG  Timboe  and  COL  Farmer,  CMDR  of  DACH,  in  August. 

DISCUSSION:  All  connectivity  was  properly  checked  out  earlier  in  the  day.  but  at  "show  time",  connectivity  with 
DACH  was  nonexistent,  and  connectivity  with  GPRMC  (Mr.  Flahie)  was  up  and  down  repeatedly.  Mr.  Flahie 
reported  telephonically  and  MsHamlin  at  last  meeting  that  adjustments  of  some  sort  were  being  performed  at 
HCSSA/USAMISSA  who  showed  NO  SCHEDULED  VTC  events  on  their  "bridge"  schedule.  CONCLUSION: 
Since  BAMC  has  dial  anywhere  capability  between  it  and  one  other  site,  no  scheduling  through  the  "bridge"  at 
HCSSA/USAMISSA  is  required.  However,  communication  is  essential  to  prevent  this  major  disruption  of  a  BAMC 
mission.  The  missions  of  BAMC  take  precedence  over  scheduled,  non  emergency  work  on  any  of  it’s  IM/ITsystems. 
ACTIONS: 

a)  Ms  Hamlin/LTC  Wittman  have  indicated  that  before  the  end  of  FY97,  at  least  one  full  time  contract  person  will 
be  hired  to  handle  HELP.  TRAINING  and  SCHEDULING  functions. 

b)  The  USAMISSA  must  CLEAR  with  BAMC  before  any  routine  maintenance  is  to  be  performed  on  MEDNET. 
etc.  POC:  Mr.  Brown  FOLLOW  UP:  This  will  be  carried  as  an  active  problem  until  after  new  personnel  have  been 
hired  and  trained. 

3.  Follow  up  inventory  of  equipment  and  operational  status  of  all  BAMC  units  (including  two  at  WHMC). 
DISCUSSION:  A  critical  starting  point  to  move  VTC/T-Med  forward  from  "stove  pipery"  to  an  integrated, 
comprehensive  entity  is  full  accountability  of  assets  in  all  areas.  Ms  Vergara  reports  that  the  BAMC  100%  inventory 
is  underway  but  not  complete.  She  is  working  with  Mr  Jones  of  BAMC  LOG.  There  is  not  yet  a  full  accountability 
for  the  Lead  Agent  unit  still  sitting  in  the  BAMC  "warehouse"  nor  do  they  have  access  so  far  to  the  two  units  at 
WHMC.  Other  equipment  such  as  that  of  Cardiology  Service  hasn't  appeared  on  the  survey,  so  all  clinical  areas  need 
to  be  entered  into  the  database  for  full  accountability.  Costing  of  units  identified  from  invoices  is  ongoing.  This 
information  is  needed  to  know  what  our  "up  front"  costs  in  infrastructure/equipment  is  to  calculate  cost  effectiveness 
of  VTC/T-Med  down  the  road. 

CONCLUSION:  Inventory  and  cost  basis  is  not  yet  complete.  ACTIONS: 

a)  Ms  Natalino  will  call  the  WHMC  IMO  POC  to  arrange  for  the  visit  of  Ms  Vergara  and  Mr  Jones  to  inventory 
BAMC  units  located  there. 

b)  Lead  Agent  (LTC  Dailey)  and  GPRMC  (Mr  Flahie)  to  provide  additional  data. 

4.  Follow  up  for  location  of  drops  at  BAMC  and  WHMC. 


ACTION:  This  is  rolled  up  into  Mr.  Flahie’s  report  to  the  committee  next  meeting. 

5.  Follow  up  about  staffing  for  centralized  HELP,  SCHEDULING,  and  TRAINING. 

ACTION: 

a)  The  hiring  of  one  contract  person  to  full  time  T-Med/VTC  is  planned  to  handle  the  HELP,  TRAINING  and 
SCHEDULING  functions.  Offers  from  Andries  Tech  and  Dwaine  Brown  of  HCSSA/USAMISSA  to  help  in  the 
TRAINING  aspects  have  been  made. 

b)  Follow  up  by  Ms  Hamlin.  LTC  Wittman.  6.  Follow  up  of  expanding  the  notion  of  a  BAMC  inventory  and 
connectivity  survey  to  include  all  MTFs  in  GPRMC  to  plan  for  greater  VTC/T-Med  connectedness  with  and  among 
each  other  and  BAMC.  DISCUSSION:  Since  connectivity  is  dependent  on  the  status  of  all  parties,  and  the  status  of 
all  MTF  T-Med/VTC  capability  is  still  largely  unknown,  a  complete  inventory  of  hardware  assets  and  drops  must  be 
known  throughout  GPRMC  and  the  city  of  San  Antonio.  Each  MTF  IMO  must  work  closely  with  the  clinical  side  to 
pinpoint  location  for  T-Med/VTC  equipment  placement  and  location  of  drops. 

CONCLUSION:  Deficient  data  on  connectivity  within  GPRMC/SATX. 

ACTION:  Mr  Flahie  has  been  in  contact  with  IMOs  throughout  GPRMC  and  the  T-Med/VTC  initiative  for 
Emergency  Departments  directed  by  BG  Timboe  is  now  adding  impetus. 

FOLLOW  UP:  no  report  this  meeting. 

7.  Follow’  up  re:  Opening  a  dialogue  with  WHMC  in  establishing  the  military  links  for  VTC/T-Med  city  wide  with 
UTHSC-SA  is  an  urgent  issue. 

DISCUSSION:  City-wide  medical  center  T-Med/VTC  connectivity  has  been  identified  as  indispensible  by  echelons 
well  placed  at  OTSG.  UTHSC-SA  President  and  Texas  legislative  levels,  but  has  been  stymied  due  to  several 
factors.  Between  last  meeting  and  the  first  meeting  of  this  working  group,  COL  Baskin,  LTC  Wittman,  Mr.  Flahie 
and  LTC  Zeigler  met  to  discuss  issues  with  bearing  on  our  current  lack  of  connectivity  with  WHMC. 
CONCLUSION:  Roadblocks  exist  that  shouldn't. 

ACTION:  An  issues  memorandum  will  be  prepared  forsubmission  to  COL  Baskin  which  will  lead  to  command  level 
dialogue  to  ease  chronic  blocks  to  mission  accomplishment. 

FOLLOW  UP:  An  issues  memorandum  was  sent  to  COL  Baskin  by  LTC  Zeigler.  action  pending. 

D.  NEW  BUSINESS: 

1 .  Cardiology  Service.  Mr  Bulgrim. 

DISCUSSION:  Mr  Bulgrim  inquired  about  store-and-forward  capability  for  echocardiologic  studies.  They  will  be 
using  DICOM  files. 

CONCLUSION:  Mr  Brown  stated  this  would  not  be  a  problem. 

ACTION:  POC:  Mr.  Bulgrim 

2.  Pediatrics,  through  LTC  Dailey  by  conversation  with  LTC  Heiman. 

Dept,  of  Peds. 

DISCUSSION:  Pediatrics  group  desires  connection  of  the  unused  NEC  VTC/T-Med  equipment  on  the  8th  floor  of 
WHMC  for  VTC  within  the  GPRMC 

CONCLUSION:  Underutilized  asset  now  sees  a  new  mission. 

ACTION:  Ms  Natalino  will  contact  the  IMO  POC  at  WHMC  about  putting  a  drop  in  the  area  designated  by 
Pediatrics.  WHMC  has  a  contract  with  the  TELCO  for  this  hardwiring  type  work. 

3.  Lead  Agent.  Region  ^6.  LTC  Dailey 

DISCUSSION:  LTC  Dailey  reports  an  upgrade  initiative  now  starting  for  the  AT&T  House  Call  Global  Med 
software. 

CONCLUSION:  Arrangements  required. 

ACTION:  LTC  Dailey  will  notify  affected  areas  with  VTC  equipment  of  this  upgrade  availability 

4.  Department  of  Pathology  and  Area  Labs,  COL  Daniels 

DISCUSSION:  COL  Daniels  requests  T-Med  and  VTC  level  connectivity  among  the  MTFs  of  GPRMC.  Currently 
each  MTF  is  connected  to  AFIP  by  POTS  (plain-old-telephone-service)  with  poor  resolution  of 
histopathology  slide  images. 

CONCLUSION:  Critical  diagnostic  decisions  rely  on  high  quality  images. 


ACTIONS:  Mr  Brown  states  that  the  MEDNET  can  support  the  mission  described.  He  will  work  with  the  other 
MTF  sites  along  with  Mr  Flahie  and  Lead  Agency  (Mr  Meints).  POC:  COL  Daniels. 

5.  Nutrition  Care  Division.  Mr  Ng 

DISCUSSION:  The  NCD  education  and  training  mission  requires  VTC  connectivity  among  several  MTFs  and 
institutions. 

CONCLUSION:  Mission  identified  and  justified. 

ACTIONS:  Ms  Natalino  will  facilitate  contact  with  the  technical  areas 
POC:  Mr  Ng 

6.  USAMISSA/HCSSA.  Mr  Brown 

DISCUSSION:  Mr  Brown  gave  the  group  the  number  to  call  for  scheduling  the  bridge  for  multipoint 
teleconferencing.  That  number  is  221-9706. 

CONCLUSION:  This  and  other  key  numbers  and  POCs  should  be  available  at  each  VTC/T-Med  unit. 

ACTION:  Compilation  of  a  user  resource  will  fall  within  the  domain  of  the  person  hired  to  the  HELP,  TRAINING, 
and  SCHEDULING  position.  Action  pending  hire. 

7.  Meeting  adjourned  at  1000.  Next  meeting  will  take  place  on  21  October.  0830-1000  in  the  Command  Conference 
Room. 

Daryl  N.  Zeigler 
LTC,  MC 
Chairman 

Chief,  Medical  Informatics  and  Telemedicine 


Minutes  of  the  T-Med/VTC  Working  Group  21  October  97 

A.  The  group’s  fourth  meeting  took  place  on  21  October  from  0830-1000  in  the  Radiology  Conference  Room. 

B.  Attendance: 

1 .  Present 

LTC  Jean  Dailey.  Lead  Agency  Region  #6  (292-3217) 

LTC  Tom  Wittman.  C.  IMD  (6-4460) 

Ms  Vicky  Hamlin.  Commo  Bi\.  IMD  (6-3600) 

Mr  Jim  Bulgrin.  Cardiology  Service  (6-2268) 

Mr  Dwaine  Brown,  USAMISSA/HCSSA  (265-2078) 

Ms  Evelyn  Vergara.  BAMC  Internal  Review  (6-2009) 

Mr  Dirck  Goss.  Andries  Tek.  Pres/CEO  (800-395-1331) 

LTC  Kathleen  David-Bajar.  Dermatology  (6-4408)  vice  COL  James  A. 

Keeling,  C,  Dermatology  Department 

ILT  Sandra  Bruno.  Patient  Admin  Section  (6-2320) 

2LT  Dan  Bridon.  IMD  (6- 1 779) 

Ms  Mary  Jane  Tuttle.  Dept,  of  Surgery  (6-5266/5 13-5539) 

LTC  Daryl  Zeigler.  Chairman  (6-1924/513-1924) 

2.  Absent 

Ms  Gerrie  Natalino.  Computer  Svc  Br.  IMD  (6-3300) 

Pam  Clement.  PhD.  Dept,  of  Psychology  (6-5779) 

COL  Franklin  Brooks.  C.  Dept,  of  Psychology  (6-1600) 

Mr  Herbert  Jones.  Sr..  Property  Book  Officer,  LOG  (6-3132) 

Mr  Mike  Flahie.  ACS  for  1M.  GPRMC  (6-6042) 

COL  John  Roscelli,  C.  Dept,  of  Pediatrics  (292-5097) 

Mr  Fred  Chriswell.  Andries  Tek,  Chief  Engineer  (800-395- 1331) 

LTC  Jan  Eagan.  C.  Clinical  Informatics.  DON  (6-4817) 

COL  Dena  Norton.  DON  (6- 1891) 

LTC  Gary  Simmons.  Dept,  of  Radiology  (6-4218) 

Mr  Bob  Meints.  Lead  Agency  Region  £6  (292-3240) 

CPT  Bill  Dixon.  Chief  Resident.  Dept,  of  Medicine  (6-1414) 

COL  Rohini  Daniels.  C.  DPALS  (6-33 1 1 ) 

Mr  Ed  Ng,  Nutrition  Care  Division  (6-3372) 

3.  Guests 

Sigrid  Gustafson.  PhD,  Virginia  Tech/AMEDD  Board  (540-231-3133) 

Robert  "Bobbie”  A.  Dean.  IMD  coming  on  board  introduction 

C.  NEW  BUSINESS: 

1.  LTC  Zeigler  brought  up  the  controversy  surrounding  a  new  MEDCOM  policy  which  has  caused  a  public  relations 
SNAFU  with  WHMC  and  UTHSC-SA.  MEDCOM  has  declared  a  three  tiered  priority  for  use  of  the  MEDCOM 
"bridge".  U\  True  Telemedicine  consultations  with  patient  care  as  the  primary  mission.  #2  General  Officer's 
videoconferencing  mission.  -3  Videoconferencing  for  administrative  purposes.  Since  the  finalized,  signed  policy  is 
notavailable  for  review,  it  is  not  currently  known  if  medical  education  (CME/GME)  will  be  considered  in  priority  =! 
or  #3.  The  bandwidth  limitation  of  128  Kbps  will  be  used  for  priority  =3.  384  Kbps  for  priority  #2.  and  whatever  is 
required  for  priority  ~  l .  "Bumping”  of  scheduled  events  will  be  in  rank  order  of  priority  #  1  >#2>#3  as  far  as  who 
does  the 

bumping  of  whom. 

This  policy,  as  Mr.  Brown  points  out,  will  not  affect  point-to-point  connectivity  that  does  not  pass  through  the 
MEDCOM  bridge.  Mr.  Flahie  has  pointed  out  (in  absentia  by  a  message)  that  128  Kbps  should  allow  enough 
resolution  using  "freeze  frame”,  but  w  ill  be  very  unsatisfactory  for  motion  of  any  kind. 


F/U:  The  impact  of  this  new  policy  will  be  monitored  and  reported  next  meeting  by  LTC  Zeigler. 

2.  LTC  Zeigler  introduced  Dr  Sigrid  Gustafson  who  is  working  under  contract  with  AMEDD  Board  to  conduct 
research  on  Telemedicine  utilization  for  outcomes  and  cost  savings.  She  has  already  worked  with  Dr.  Kobylarz  and 
others  to  line  up  DACH  at  Ft  Hood  in  the  research  endeavor.  She,  Ms  Linda  Drzymalla,  Ms  Adrea  Gulledge,  Mr 
Walt  Prescher  and  LTC  Zeigler  met  yesterday  to  go  over  the  new  ADS  v.2.0  "bubble  sheet"  which  will  add  one  line 
to  the  "clinical  use  only"  section  for  "Telemedicine  Consultation. ..A=yes,  B=no".  This  will  be  added  only  to  the 
clinics  which  have  an  active  telelemedicine  consultation  initiative  and  be  used  for  collection  of  data. 

3.  Ms  Vicky  Hamlin  introduced  Bobbie  Dean,  who  is  hired  into  IMD  for  the  SCHEDULING,  TRAINING  and 
HELP  functionality  for  which  BAMC's  Videoconferencing  and  Telemedicine  efforts  will  greatly  benefit. 

D.  OLD  BUSINESS: 

1.  Follow  up  of  clinical  areas. 

a.  Dept,  of  Medicine 

1)  Conversion  of  DOM,  BAMC.  conference  room  from  point-to-point  with  Tremmier  Clinic,  Ft  Hood  to  diai- 
anywhere  capability  in  preparation  for  a  13.  14  November  Army  American  College  of  Physicians  videoconference 
coming  from  WRAMC  across  the  AMEDD.  Mr  Ken  Trawick  of  USAMISSA  and  AndriesTek  are  working  the 
technical  aspects  of  the  conversion  and  connectivity.  November  6  is  the  deadline  to  have  all  aspects  installed  and 
checked  out. 

2)  Conversion  of  the  Tremmier  Clinic  at  Ft  Hood  to  dial-anywhere  connectivity.  This  is  being  worked  by  Mr  Ed 
Pitts  at  Ft  Hood,  AndriesTek.  and  USAMISSA. 

FOLLOW  UP:  AndriesTek.  CPT  Dixon.  Ms  Hamlin,  Mr  Brown,  POC  @  Ft  Hood  in 
DOM  is  Cpt  Howser  (254)634-7647. 

b.  Cardiology  Service.  Mr.  Bulgrin.  requested  relocation  of  Cardiology  Conference  Room  gear  to  an  adjacent  room 
(331-5)  as  upgrade  of  existing  conferencing  capability  is  occurring. 

CONCLUSION:  Clinical  VTC/T-Med  need  identified. 

ACTION:  Ms.  Hamlin,  et  al  from  IMD  will  work  with  Cardiology  to 
accomplish  upgrades  and  connections. 

ACTION:  The  GlobalMed  (AT&TVCLI  equipment  is  not  dial-anywhere  and 
will  require  further  hardware  solutions. 

F/U:  Lead  Agent,  BAMC  IMD  Comtno  Br.  to  report  next  meeting. 

c.  Dermatology 

Need  conversion  of  their  equipment  to  dial-anywhere 
F/U:  Lead  agent 

d.  Nutrition  Care  Directorate  Need  VTC  equipment,  drops,  the  whole  request  reviewed  and  negotiated. 

F/U:  Mr  Ng,  Ms  Hamlin,  Mr  Flahie 

e.  Pediatrics 

Need  to  move  the  NEC  unit  from  8th  floor  Peds  at  WHMC  to  BAMC  Peds  clinic,  remove  unit  in  Peds  Clinic  to 
WHMC  portable  classroom  #2  for  COL  Roscelli's  morning  rounds  conference.  Need  to  check  status  of  Peds 
equipment  and  connectivity  at  DACH. 

F/U:  Lead  Agent.  1LT  Bruno.  Ms  Hamlin.  AndriesTek 


f.  Department  of  Surgery 

Ms  Tuttle  reported  on  the  desired  locations  for  VTC.  The  primary  sites  are  Chief.  DOS  office  area  (270-20)  with 
another  site  to  be  named.  Two  items  of  equipment  are  listed  as  a  desktop  unit  and  a  NEC  unit. 

F/U:  Lead  Agent,  AndriesTek.  Ms  Hamlin.  Ms  Tuttle 


g.  Clinical  Psychology  Service 
No  report  this  meeting. 

F/U:  COL  Brooks,  Dr  Clement 

h.  Department  of  Pathology  and  Area  Labs 
No  report  this  meeting 

F/U:  COL  Daniels.  AndriesTek 

i.  Emergency  Departments  BAMC  and  GPRMC 
Directed  by  BG  Timboe.  Awaiting  input  from  BAMC  EMD. 

F/U:  COL  Pfaff,  LTC  Sheridan 

j-  ENT 

No  representation  yet. 

F/U  MAJ  Mahoney 

2.  Follow  up  inventory  of  equipment  and  operational  status  of  all  BAMC  units  (including  two  at  WHMC).  Ms 
Vergara  reports  nearly  a  nearly  completed  inventory  but  must  meet  with  Mr  Jones  to  reconcile  with  the  BAMC 
100%  inventory  in  September.  She  is  also  attempting  to  track  down  the  purchase  price  of  all  VTC  equipment 
purchased  and  in  inventory.  This  information  will  serve  as  a  cost  of  "overhead"  and  initial  investment  to  determine 
the  point  of  return  on  investment. 

F/U:  Lead  Agent.  Ms  Vergara  and  Mr  Jones  (see  attached  file  "barncinM.xls") 

3.  Location  of  drops  at  BAMC.  DACH.  (see  attached  files  "dropsnew.xls"  and  "nec_numl.xls") 

F/U:  Pending  Mr  Flahie's  report  to  the  committee  next  meeting. 

4.  Expanding  the  notion  of  a  BAMC  inventory  and  connectivity  survey  to  include  all  MTFs  in  GPRMC  to  plan  for 
greater  VTC/T-Med  connectedness  with  and  among  each  other  and  BAMC. 

F/U:  Pending  Mr  Flahie's  report  to  the  committee  next  meeting. 

5.  Dialogue  with  WHMC  in  establishing  the  military  links  for 

VTC/T-Med  city  wide  with  UTHSC-SA.  Meetings  have  taken  place  between  WHMC  and  BAMC  IMOs.  Dialogue 
is  ongoing  citywide  with  LTC  Zeigler  and  Dr  Gustafson's  participation  in  the  Telehealth  initiative  meeting  at 
UTHSC-SA  yesterday. 

F/U:  This  will  not  be  reported  in  future  minutes.  Action  closed. 

6.  Meeting  adjourned  at  0945.  Next  meeting  will  take  place  on  18  November.  0830-1000  in  the  Radiology 
Conference  Room. 

Daryl  N.  Zeigler 
LTC,  MC 
Chairman 

Chief,  Medical  Informatics  and  Telemedicine 


Closed/Retired  Actions: 

a.  Audio  intrusion  from  UTHSC-SA  on  an  Ophthalmology  Service  three-way  VTC  with  WHMC  and  UT-Galveston. 


DISCUSSION:  Mr  Brown  reports  investigation  of  the  problem  detected  a  hardware  problem  at  the  V-Tel  bridge  of 
UTHSC-SA.  This  is  actively  being  remedied. 

CONCLUSION:  Problem  identified. 

ACTIONS:  To  prevent  similar  problems  originating  from  his  area,  Mr  Brown  has  examined  HCSSA/USAMISSA 
bridge  operations  with  process  improvement  as  a  goal.  This  has  lead  to  designating  separate  "black  boxes"  for  T- 
Med  (patient  care)  from  VTC  (talking  heads)  use.  Access  will  be  greatly  limited  to  the  patient  care  "box". 

FOLLOW  UP:  Mr.  Brown  on  status  of  UTHSC-SA  V-Tel 
ACTION:  Closed  due  to  no  further  action  deemed  appropriate. 

b.  Follow  up  of  command  areas.  Problem  with  failed  VTC  between  BG  Timboe  and  COL  Farmer,  CMDR  of 
DACH.  in  August. 

DISCUSSION:  All  connectivity  was  properly  checked  out  earlier  in  the  day,  but  at  "show  time",  connectivity  with 
DACH  was  nonexistent,  and  connectivity  with  GPRMC  (Mr.  Flahie)  was  up  and  down  repeatedly.  Mr.  Flahie 
reported  telephonically  and  Ms  Hamlin  at  last  meeting  that  adjustments  of  some  sort  were  being  performed  at 
HCSSA/USAMISSA  who  showed  NO  SCHEDULED  VTC  events  on  their  "bridge"  schedule. 

CONCLUSION:  Since  BAMC  has  dial  anywhere  capability  between  it  and  one  other  site,  no  scheduling  through  the 
"bridge"  at  HCSSA/USAMISSA  is  required.  However,  communication  is  essential  to  prevent  this  major  disruption 
of  a  BAMC  mission.  The  missions  of  BAMC  take  precedence  over  scheduled,  non  emergency  work  on  any  of  it's 
IM/IT  systems. 

ACTIONS: 

a)  Ms  Hamlin/LTC  Wittman  have  indicated  that  before  the  end  of  FY97,  at  least  one  fiill  time  contract  person  will 
be  hired  to  handle  HELP.  TRAINING  and  SCHEDULING  functions. 

b)  The  USAMISSA  must  CLEAR  with  BAMC  before  any  routine  maintenance  is  to  be  performed  on  MEDNET, 
etc.  POC:  Mr.  Brown 

FOLLOW  UP:  Mr  Brown  reported  no  log  evidence  of  network  failure  or  "adjustments"  being  performed. 

ACTION:  closed. 


Minutes  of  the  T-Med/VTC  Working  Group  1 8  November  97 

A.  The  group’s  fifth  meeting  took  place  on  18  November  from  0830-1000  in  the  Radiology  Conference  Room.  B. 
Attendance: 

1 .  Present 

LTC  Jean  Dailey,  Lead  Agency  Region  #6  (292-3217) 

Ms  Vicky  Hamlin,  Commo  Br..  1MD  (6-3600,  513-9410) 

Mr  Bobby  Dean,  VTC/T-Med  Administrator,  IMD,  (6-2882,  513-1910) 

Mr  Jim  Bulgrin,  Cardiology  Service  (6-2268) 

Mr  Herbert  Jones,  Sr.,  Property  Book  Officer,  LOG  (6-3132) 

LTC  Kathleen  David-Bajar.  Dermatology  (6-4408)  vice 

COL  James  A.  Keeling.  C,  Dermatology  Department 

Mr  Fred  Chriswell.  Andries  Tek.  Chief  Engineer  (800-395-1331) 

Mr  Frank  Murphy,  HCSSA/SAIC  (265-2090) 

Mr  Mike  Flahie,  ACS  for  IM.  GPRMC  (6-6042) 

LTC  Daryl  Zeigler.  Chairman  (6-1924,  513-1924) 

2.  Absent 

LTC  Tom  Wittman.  C,  IMD  (6-4460) 

Ms  Gerrie  Natalino.  Computer  Svc  Br.  IMD  (6-3300) 

Pam  Clement,  PhD.  Dept,  of  Psychology  (6-5779) 

COL  Franklin  Brooks,  C.  Dept,  of  Psychology  (6-1600) 

COL  John  Roscelli.  C.  Dept,  of  Pediatrics  (292-5097) 

LTC  Jan  Eagan.  C.  Clinical  Informatics,  DON  (6-4817) 

COL  Dena  Norton,  DON  (6- 1891) 

LTC  Gary  Simmons.  Dept,  of  Radiology  (6-4218) 

Mr  Bob  Meints,  Lead  Agency  Region  #6  (292-3240) 

CPT  Bill  Dixon,  Chief  Resident.  Dept,  of  Medicine  (6-1414) 

COL  Rohini  Daniels,  C.  DPALS  (6-331 1) 

Mr  Ed  Ng,  Nutrition  Care  Division  (6-3372) 

Mr  Dwaine  Brown.  US  AMISS  A  HCSSA  (265-2078) 

Ms  Evelyn  Vergara.  BAMC  Internal  Review  (6-2009) 

Mr  Dirck  Goss,  Andries  Tek.  Pres  CEO  (800-395-1331) 

ILT  Sandra  Bruno.  Patient  Admin  Section  (6-2320) 

2LT  Dan  Bridon.  Security  Officer.  IMD  (6-1779) 

Ms  Mary  Jane  Tuttle.  Dept,  of  Surgery  (6-5266/513-5539) 

3.  Guest 

Mr  Ken  Weber,  USA1AR/IM  (6-3678) 

C.  OLD  BUSINESS: 

1.  Follow  up  of  clinical  areas. 

a.  Dept,  of  Medicine 

1)  Conversion  of  DOM,  BAMC.  conference  room  from  point-to-point  with  Tremmier  Clinic,  Ft  Hood  to  dial- 
anywhere  capability  in  preparation  for  a  13,  14  November  Army  American  College  of  Physicians  videoconference 
coining  from  WRAMC  across  the  AMEDD.  Mr  Ken  Trawick  of  USAMISSA  and  AndriesTek  are  working  the 
technical  aspects  of  the  conversion  and  connectivity.  November  6  is  the  deadline  to  have  all  aspects  installed  and 
checked  out. 

2)  Conversion  of  the  Tremmier  Clinic  at  Ft  Hood  to  dial-anyvvhere  connectivity.  This  is  being  worked  by  Mr  Ed 
Pitts  at  Ft  Hood.  AndriesTek.  and  USAMISSA. 


FOLLOWUP:  (18  NOV  07) 


1)  The  DOM  Conf  Rin  was  used  on  13  and  14  NOV  97  for  a  live  VTC  from  Washington,  DC  for  the  Army 
American  College  of  Physicians  annual  meeting.  The  DOM  NEC  unit  was  not  operational  in  time,  so  a  new 
PictureTel  unit  was  retrieved  from  warehouse,  assembled,  installed,  and  worked  flawlessly  throughout  the  two  day 
meeting. 

2)  Problems  that  have  not  yet  been  solved  remain  in  connecting  DOM-BAMC  to  Tremmier  Clinic-DACH. 

ACTION:  (18  NOV  97) 

1)  NEC  equipment  will  be  renovated  and  returned  to  DOM.  The  PictureTel  unit  will  be  pulled  back  for  reserve. 

2)  POCs:  AndriesTek.  CPT  Dixon,  Ms  Hamlin,  Mr  Brown,  and  POCs  @  Ft  Hood  in  DOM  is  Cpt  Howser  (254)634- 
7647  and  Mr  Ed  Pitts  for  DACH  IMD.  b.  All  other  Clinical  Areas  previously  reported:  (18  NOV  97)  A  mark  is  on 
the  wall  for  completing  all  dial-anywhere  conversions  of  BAMC  VTC/T-Med  equipment  with  hot  wall  drops,  line 
drivers,  teleos  port  connectivity  for  a  100%  operational  scenario  by  3 1  DEC  97.  ACTION:  The  ball  is  in  the 
engineering/technical  court  to  meet  this  goal.  All  clinical  area  POCs  have  their  name  and  phone/pager  number  listed 
in  all  minutes  of  this  working  group  since  inception. 

F/U:  Mr  Flahie,  Mr  Brown.  Mr  Criswell,  Mr  Murphy,  Mr  Dean,  Ms  Hamlin 

c.  Emergency  Departments  BAMC  and  GPRMC 

Directed  by  BG  Timboe.  Awaiting  input  from  BAMC  EMD. 

F/U:  COL  Pfaff.  LTC  Sheridan 

ACTION:  (18  nov  97)  LTC  Zeigler  will  seek  clarification  of  BG  Timboe's  intent  on  this  issue  and  will  meet  with  the 
CG  and  COL  Baskin  on  16  DEC  97  in  lieu  of  a  December  VTC/T-Med  WG  meeting. 

2.  Follow  up  inventory  of  equipment  and  operational  status  of  all  BAMC  units  (including  two  at  WHMC).  Ms 
Vergara  reports  nearly  a  nearly  completed  inventory  but  must  meet  with  Mr  Jones  to  reconcile  with  the  BAMC 
100%  inventory  in  September.  She  is  also  attempting  to  track  down  the  purchase  price  of  all  VTC  equipment 
purchased  and  in  inventory.  This  information  will  serve  as  a  cost  of  "overhead"  and  initial  investment  to  determine 
the  point  of  return  on  investment. 

F/U:  Lead  Agent,  Ms  Vergara  and  Mr  Jones 

ACTION:  (18  NOV  97)  Still  no  report  of  total  inventory  or  of  initial  $$  outlay  for  current  inventory. 

FOLLOWUP:  Lead  Agent.  Ms  Vergara  and  Mr  Jones  at  January  meeting.  3.  Expanding  the  notion  of  a  BAMC 
inventory  and  connectivity  survey  to  include  all  MTFs  in  GPRMC  to  plan  for  greater  VTC/T-Med  connectedness 
with  and  among  each  other  and  BAMC. 

F/U:  Mr  Flahie^ 

ACTION:  ( 1 8  NOV  97)  Mr  Flahie  did  report  that  BAMC  has  up  to  32  ports  for  VTC/T-Med  connectivity  which 
should  be  adequate  for  current  and  future  needs  based  on  projections  without  new  equipment  being  added  to  the 
inventory. 

F/U:  Pending  Mr  Flahie's  report  to  the  committee  in  January  '98. 

4.  LTC  Zeigler  brought  up  the  controversy  surrounding  a  new  MEDCOM  policy  which  has  caused  a  public  relations 
SNAFU  with  WHMC  and  UTHSC-SA.  MEDCOM  has  declared  a  three  tiered  priority  for  use  of  the  MEDCOM 
"bridge".  #1  True  Telemedicine  consultations  with  patient  care  as  the  primary  mission.  #2  General  Officer's 
videoconferencing  mission.  #3  Videoconferencing  for  administrative  purposes.  Since  the  finalized,  signed  policy  is 
not  available  for  review,  it  is  not  currently  known  if  medical  education  (CME/GME)  will  be  considered  in  priority 
#1  or  #3.  The  bandwidth  limitation  of  128  Kbps  will  be  used  for  priority  #3,  384  Kbps  for  priority  #2,  and  whatever 
is  required  for  priority  #1 .  "Bumping"  of  scheduled  events  will  be  in  rank  order  of  priority  #1>#2>#3  as  far  as  who 
does  the  bumping  of  whom.  This  policy,  as  Mr.  Brown  points  out.  will  not  affect  point-to-point  connectivity  that 
does  not  pass  through  the  MEDCOM  bridge.  Mr.  Flahie  has  pointed  out  (in  absentia  by  a  message)  that  128  Kbps 
should  allow  enough  resolution  using  "freeze  frame",  but  will  be  very  unsatisfactory  for  motion  of  any  kind. 

F/U:  The  impact  of  this  new  policy  will  be  monitored  and  reported  next  meeting  by  LTC  Zeigler.  ACTION: 

( 1 8NOV  97)  LTC  Zeigler  reported  a  favorable  response  to  the  new  policy  draft.  Review  of  the  new  policy  draft  was 
performed  by  personnel  at  USAHSC-SA  and  WHMC. 

F/U:  Monitoring  is  no  longer  needed  so  this  issue  will  be  dropped  from  future  minutes. 


5.  LTC  Zeigler  introduced  Dr  Sigrid  Gustafson  who  is  working  under  contract  with  AMEDD  Board  to  conduct 
research  on  Telemedicine  utilization  for  outcomes  and  cost  savings.  She  has  already  worked  with  Dr.  Kobylarz  and 
others  to  line  up  DACH  at  Ft  Hood  in  the  research  endeavor.  She,  Ms  Linda  Drzymalla.  Ms  Adrea  Gulledge,  Mr 
Walt  Prescher  and  LTC  Zeigler  met  yesterday  to  go  over  the  new  ADS  v.2.0  "bubble  sheet"  which  will  add  one  line 
to  the  "clinical  use  only"  section  for  "Telemedicine  Consultation. ..A=yes,  B=no".  This  will  be  added  only  to  the 
clinics  which  have  an  active  telelemedicine  consultation  initiative  and  be  used  for  collection  of  data. 

ACTION:  (18  NOV  97)  Ms  Andrea  Guledge  (ADS/PAD)  reported  in  an  e-mail  message  to  LTC  Zeigler  that 
Dermatology  and  Cardiology  ADS  encounter  forms  should  have  the  new  Telemedicine  Consultation  line  added 
within  -3  weeks. 

F/U:  Dr  Zeigler,  Ms  Gulledge 

D.  NEW  BUSINESS: 

1.  Mr  Ken  Weber  was  introduced  as  the  new  USAISR  IM  chief  with  interest  in  participation  in  this  committee.  Mr 
Weber  is  welcomed  as  the  newest  member  for  liaison  between  the  separate  commands  and  budgets  in  matters  of 
distance  learning  and  telemedicine. 

2.  Several  new  initiatives  have  surfaced  for  consideration  at  the  next  meeting  in  January  ’98: 

a.  A  distance  learning  classroom/center  within  BAMC.  This  concept  is  working  its  way  around  COL  Gonzales,  COL 
Srsic-Stor,  COL  McNabb.  LTC  Hepier.  LTC  Wittman,  et  al  via  ccMail. 

F/U:  all  those  listed  plus  Mr  Dean.  Ms  Hamlin,  and  LTC  Zeigler. 

b.  COL  Gail  M.  Johnson.  MEDEL  Cmdr  at  JTF-B  in  Soto  Cano,  Honduras,  contacted  LTC  Zeigler  via  ccMail  thru 
COL  Baskin  to  obtain  distance  learning  opportunities  for  CME/CEU  and  Teleconsultation  after  the  installation  team 
has  their  units  operational  after  the  first  week  of  December. 

ACTION:  E-mail  contact  has  been  maintained  and  LTC  Zeigler  provided  copy  to  Mr  Bobby  Dean  for  further 
coordination. 

F/U:  Mr  Dean  and  COL  Johnson's  LOG  Officer.  CPT  Neri. 

3.  Mr  Flahie  and  Mr  Murphy  reported  that  the  VTC/T-Med  equipment  that  was  reclaimed  from  the  closure  of  the 
US  Army  Hospital.  Panama,  is  in  poor  condition.  Parts  may  be  scavenged  for  other  units  at  BAMC. 

4.  Mr  Flahie  and  LTC  Dailey  report  that  policy  review  will  be  needed  since  several  sites,  most  recently  Wm 
Beaumont  AMC  in  El  Paso,  come  under  GPRMC  but  are  not  included  in  TriCare  Region  6.  Therefore,  the  billing, 
etc.  for  TeleConsultation  will  be  a  problematic  issue  unless  agreements  are  negotiated  between  regions. 

F/U:  This  issue  will  be  taken  to  the  TriCare  Region  6  local  office  by  LTC  Dailey. 

5.  LTC  Zeigler  raised  the  issue  of  Store  and  Forward  TeleConsultation  and  MEPRS  Workload  rulings.  Since  the 
consultant  may  not  see  the  patient  face  to  face,  this  could  be  problematic  in  obtaining  a  clinic  "count"  for  clinician 
workload. 

F/U:  LTC  will  take  the  issue  to  BAMC  RMD,  LTC  Hepier  and  Ms  Gloria  Paige  for  discussion  and  a  ruling. 

6.  Meeting  adjourned  at  0945.  Next  meeting  will  take  place  on  20  January  1998.  0830-1000  in  the  Radiology 
Conference  Room  (NB-This  room  has  been  prescheduled  for  the  3rd  Tuesday  of  every  month  in  1998  for  these 
meetings). 

There  will  not  be  a  meeting  of  the  VTC/T-Med  WG  in  December,  but  reports  on  progress  for  the  3  1  DEC  97  mark 
on  the  wall  should  be  submitted  to  LTC  Zeigler  by  16  DEC  97  (Mr  Flahie,  Ms  Hamlin.  Mr  Dean.  Mr  Brown.  Mr 
Murphy). 


Daryl  N.  Zeigler 
LTC,  MC 
Chairman 

Chief.  Medical  Informatics  and  Telemedicine 
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Minutes  of  the  T-Med/VTC  Working  Group  23  January  1998 

A.  The  group's  sixth  meeting  took  place  on  20  January  98  from  0830-0930  in  the  Radiology  Conference  Room.  The 
group  did  not  meet  in  December  1997. 

B.  Attendance: 

1.  Present 

LTC  Tom  Wittman,  C.  IMD  (6-4460) 

Ms  Vicky  Hamlin,  Commo  Br.,  IMD  (6-3600,  513-9410) 

Mr  Bobby  Dean,  VTC/T-Med  Administrator,  IMD,  (6-2882,  513-1910) 

Mr  Ken  Weber,  USAIAR/IM  (6-3678) 

LTC  Kathleen  David-Bajar.  Dermatology  (6-4408)  vice  COL  James  A. 

Keeling,  C,  Dermatology  Department 

MAJ  Brian  Kendall.  DPALS  (6-0444),  vice  COL  Rohini  Daniels.  C.  DPALS  (6-331 1) 

Mr  Fred  Chriswell.  Andries  Tek.  Chief  Engineer  (800-395-133 1  or  512-453-6076) 

Ms  Evelyn  Vergara.  BAMC  Internal  Review  (6-2009) 

Ms  Mary  Jane  Tuttle.  Dept  of  Surgery  (6-5266/513-5539) 

LTC  Jan  Eagan.  Dept  of  Nursing  (6-4817)  vice  COL  Dena  Norton  (6-1891) 

COL  Michael  Cawthon  (6-3290).  Dept  of  Radiology  vice  LTC  Gary  Simmons, 

(6-4218) 

LTC(P)  Daryl  Zeigler.  Chairman  (6-1924,  513-1924) 

2.  Absent 

LTC  Jean  Dailey.  Lead  Agency  Region  #6  (292-3217) 

Ms  Gerrie  Natalino,  Computer  Svc  Br,  IMD  (6-3300) 

Pam  Clement,  PhD.  Dept,  of  Psychology  (6-5779) 

COL  Franklin  Brooks.  C,  Dept  of  Psychology  (6-1600) 

COL  John  Roscelli.  C.  Dept  of  Pediatrics  (292-5097) 

Mr  Frank  Murphy,  HCSSA/SAIC  (265-2090) 

Mr  Jim  Bulgrin,  Cardiology  Service  (6-2268) 

Mr  Herbert  Jones,  Sr..  Property  Book  Officer,  LOG  (6-3132) 

Mr  Bob  Meints,  Lead  Agency  Region  #6  (292-3240) 

CPT  Bill  Dixon,  Chief  Resident.  Dept,  of  Medicine  (6-1414) 

Mr  Ed  Ng,  Nutrition  Care  Division  (6-3372) 

Mr  Dwaine  Brown.  USAMtSSA/HCSSA  (265-2078) 

Mr  Dirck  Goss,  Andries  Tek.  Pres  CEO  (800-395-133 1 ) 
i  LT  Sandra  Bruno,  Patient  Admin  Section  (6-2320) 

2LT  Dan  Bridon,  Security  Officer.  IMD  (6-1779) 

Mr  Mike  Flahie.  ACS  for  IM.  GPRMC  (6-6042) 

Ms  Andrea  Gulledge.  PAD/ADS  (6- 

C.  OLD  BUSINESS: 


1 .  Follow  up  of  clinical  areas. 


a.  All  clinical  connectivity  issues  are  pending  a  definitive  engineering  test  of  the  21  NEC  units  deployed  at  BAMC 
and  GPRMC.  Reports  indicate  that  these  units  are  very  questionable  in  their  reliability  since  conversion  from  point- 
to-point  to  dial-anywhere  capability  with  the  installed  v.35  card. 

CONCLUSION:  Unreliability  of  NEC  units  has  been  identified.  ACTION:  Ms  Hamlin.  Mr  Dean.  Mr  Flahie,  and  Mr 
Chriswell  will  arrange  for  testing  to  take  place  on  Wednesday,  28  Jan.  Mr  Chriswell  will  arrange  with  NEC  to  have 
a  service  technician  available  on  Thursday  29  Jan.  Mr  Flahie  will  report  the  test  results  to  LTC(P)  Zeigler  NLT  COB 
(1630)  Friday.  30  Jan  98. 

Options: 

1)  NEC  will  implement  a  satisfactory  repair  of  all  units  with  v.35  cards. 

2)  If  1)  fails,  another  vendor's  codec  will  be  installed  to  replace  that  of  NEC  for  a  trial  of  reliability. 

3)  If  2)  fails,  new  units  will  have  to  be  purchased  to  replace  all  21  NEC  units. 

b.  Emergency  Departments  BAMC  and  GPRMC  Directed  by  BG  Timboe.  Awaiting  input  from  BAMC  EMD.  F/U: 
COL  Pfaff,  LTC  Sheridan 

ACTION:  (18  Nov  97)  LTC  Zeigler  will  seek  clarification  of  BG  Timboe's  intent  on  this  issue  and  will  meet  with 
the  CG  and  COL  Baskin  on  16  DEC  97  in  lieu  of  a  December  VTC/T-Med  WG  meeting. 

F/U:  (20  Jan  98)  Dr  Zeigler  has  the  CG's  clarification.  A  memorandum  thru  COL  Baskin  to  all  MTF  commanders 
was  sent  through  distribution  and  responses  have  begun  to  trickle  in. 

ACTION:  LTC(P)  Zeigler  will  report  next  meeting. 

2.  Follow  up  inventory  of  equipment  BAMC  and  GPRMC. 

Ms  Vergara  reports  a  nearly  completed  inventory,  but  must  meet  with  Mr  Jones  to  reconcile  with  the  BAMC  100% 
inventory  in  September.  She  is  also  attempting  to  track  down  the  purchase  price  of  all  VTC  equipment  purchased 
and  in  inventory.  This  information  will  serve  as  a  cost  of  "overhead"  and  initial  investment  to  determine  the  point  of 
return  on  investment. 

F/U:  Lead  Agent.  Ms  Vergara  and  Mr  Jones 

ACTION:  (18  NOV  97)  Still  no  report  of  total  inventory  or  of  initial  $$  outlay  for  current  inventory. 

FOLLOWUP:  Lead  Agent.  Ms  Vergara  and  Mr  Jones  at  January  meeting. 

F/U:  (20  Jan  98)  Ms  Vergara  submitted  a  first  draft  spread  sheet  of  inventory  with  cost  figures  that  are  preliminary. 
Further  refinement  will  be  required.  BAMC  budget  costs  should  be  broken  our  from  GPRMC  expenditures  and  Lead 
Agent  expenditures.  The  grand  total  of  unit  costs  for  BAMC  and  GPRMC  at  $6.468. 670  may  not  be  the  final  figure 
once  cross  checks  are  performed  with  Mr  Jones.  LOG/Propertv  Book.  Mr  Flahie  for  GPRMC  and  LTC  Dailey  for 
Lead  Agent  VI. 

ACTION:  Ms  Vergara.  Mr  Flahie.  Mr  Jones  to  report  revised  figures  next  meeting. 

3.  A  distance  learning  classroom/VTC  center  is  under  construction  within  BAMC. 

F/U:  (20  Jan  98)  all  is  in  place,  only  air  conditioning  and  room  ventilation  remains  to  be  done. 

ACTION:  COL  McNabb,  LTC  Wittman.  Mr  Dean,  and  Ms  Hamlin. 

4.  Mr  Flahie  and  LTC  Dailey  report  that  policy  review  will  be  needed  since  several  sites,  most  recently  Win 
Beaumont  AMC  in  El  Paso,  come  under  GPRMC  but  are  not  included  in  TriCare  Region  6.  Therefore,  the  billing, 
etc.  for  TeleConsultation  will  be  a  problematic  issue  unless  agreements  are  negotiated  between  regions. 

F/U:  This  issue  will  be  taken  to  the  TriCare  Region  6  local  office  by  LTC  Dailey. 

F/U:  (20  Jan  98)  No  report 
ACTION:  Per  LTC  Dailey 

5.  LTC  Zeigler  raised  the  issue  of  Store  and  Forward  TeleConsultation  and  MEPRS  Workload  rulings.  Since  the 
consultant  may  not  see  the  patient  face  to  face,  this  could  be  problematic  in  obtaining  a  clinic  "count"  for  clinician 
workload. 

F/U:  LTC  will  take  the  issue  to  BAMC  RMD.  LTC  Hepler  and  Ms  Gloria  Paige  for  discussion  and  a  ruling. 

F/U:  Dr  Zeigler  has  verbal  understanding  that  the  workload  will  count  the  same  as  a  telephone  consultation  and  must 
have  the  required  documentation 
of  care  provided. 

ACTION:  Ms  Anrea  Gulledge  will  assure  that  the  ADS  forms  will  have,  in  the 


"For  Clinic  Use  Only,"  a  line  for  Telemedicine  Consults  A=yes,  B=no  for  at 
least  Dermatology,  Psychology,  Pediatrics,  and  Cardiology  to  start  with. 

F/U:  (20  Jan  98)  No  report.  Report  next  meeting  by  Ms  Gulledge. 

6.  COL  Gail  M.  Johnson.  MEDEL  Cmdr  at  JTF-B  in  Soto  Cano,  Honduras,  contacted  LTC  Zeigler  via  ccMail  thru 
COL  Baskin  to  obtain  distance  learning  opportunities  for  CME/CEU  and  Teleconsultation  after  the  installation  team 
has  their  units  operational  after  the  first  week  of  December. 

ACTION:  E-mail  contact  has  been  maintained  and  LTC  Zeigler  provided  copy  to  Mr  Bobby  Dean  for  further 
coordination. 

F/U:  Mr  Dean  and  COL  Johnson's  LOG  Officer,  CPT  Neri. 

F/U:  (20  Jan  98)  Mr  Dean  has  made  contact  with  CPT  Neri.  Calls  to  Honduras  must  be  placed  through  the  Pensacola 
Naval  Station,  Florida.  The  POC  for  placing  VTC  calls  is  Mr.  Ted  Hassebroch  @  DSN  922-3501.  Mr  Dean  and  Mr 
Hassebroch  have  placed  a  successful  call  @  384  Kbps  between  BAMC  and  Pensacola.  The  JTF-B  was  having 
installation  of  equipment  the  first  week  of  Dec  97.  No  word  on  that  project.  ACTION:  Mr  Dean  will  recontact  CPT 
Neri  to  determine  equipment  status  and  test  connectivity.  Report  next  meeting. 

D.  NEW  BUSINESS: 

1.  Mr  Ken  Weber  listed  three  VTC/T-Med  initiatives  for  ISR.  (See  Addendum  below) 

2.  Dr.  Zeigler  reported  that  a  VTC  with  several  AMEDD  Medical  Centers  and  the  OTSG  consultant  for 
telemedicine,  COL  Sado.  will  take  place  on  Thursday,  21  Jan,  from  1300-1500  in  the  5th  floor  VTC  suite.  This  VTC 
is  for  discussion  of  successful  projects,  impediments  to  full  VTC/T-Med  utilization  and  funding.  LTC(P)  Zeigler 
will  report  next  meeting. 

3.  Meeting  adjourned  at  0930.  Next  meeting  will  take  place  on  17  February  1998,  0830-1000  in  the  Radiology 
Conference  Room.  (NB-This  room  has  been  prescheduled  for  the  3rd  Tuesday  of  every  month  in  1998  for  these 
meetings) 

- /s/ - 

Daryl  N.  Zeigler 
LTC(P),  MC 
Chairman 

Chief,  Medical  Informatics  and  Telemedicine 
ADDENDUM 

Telemedicine  requirements  and  initiatives  at  the  Institute  Of  Surgical  Research  and  Burn  Unit 

Dr.  Zeigler;  The  following  initiatives  are  in  the  early  development  stages,  but  should  give  you  and  the  telemedicine 
team  some  ideas  of  telemedicine  utilization  by  the  ISR  and  Bum  Team: 

1.  Telemedicine  for  bum  size  estimation  Prospective  trial  comparing  referring  hospitals'  and  telemedicine 
consultants'  ability  to  judge  burn  size.  This  protocol  will  probably  involve  support  from  burn  surgeons  at  other 
locations  as  the  consultants.  To  be  submitted  to  Research  Council  for  implementation  in  next  FY. 


2.  Telebronchoscopv 

Pilot  study  to  establish  telemedicine  resources  necessary  to  perform  accurate  diagnosis  of  the  presence  or  absence  of 
smoke  inhalation  injury.  Use  of  a  Olympus  bronchoscope  system  would  be  digitized  and  sent  via  telemedicine 
capabilities.  Prospective  trial  of  ability  of  a  telemedical  consultant  to  accurately  diagnose  smoke  inhalation  injury  on 
basis  of  images  transmitted  by  Burn  Flight  Team  from  referring  hospitals. 

3.  Distance  Learning 

Setup  an  area  in  the  Burn  Unit  to  accommodate  a  telemedicine  link  for  educational  purposes  on  burn  case  studies  to 
other  hospitals,  burn  research  centers,  and  military  facilities.  These  initiatives  have  not  formally  been  sanctioned,  but 
are  undergoing  review  and  discussion  by  the  clinical  team.  Use  of  existing  NEC  telemedicine  stations  for  these  tests 
would  be  beneficial  to  explore  the  feasibility  in  these  areas.  KEN 
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TELEMEDICINE 


Telemedicine  Initiative 

User  Survey 

To  be  completed  by  initiative  site  and  returned  before  briefing  and  site  visit 


Title  of  initiative:  Brooke  Army  Medical  Center  Telemedicine  Working  Group 


Point  of  contact: 

Name:  Daryl  N.  Zeigler,  MD  (LTC-P,  US  Army,  MC) 

Title:  Chief,  Medical  Informatics  and  Telemedicine  (MCHE-PMR) 

Address:  3851  Roger  Brooke  Drive,  Fort  Sam  Houston,  TX  78234-6200 

Telephone:  (210)916-1924 
FAX:  (210)  916-0598 

Email:  ltc_daryl_zeigler@BAMC.SMTPLINK.AMEDD.ARMY.MIL 

URL. 

Initiative  proponent  or  sponsor:  Same  as  above 


Description  of  initiative: 

describe  the  overall  objective ,  current  practice  or  approach,  limitations  of  current  practice  that  will  be 
addressed  by  the  new  technology >,  and  method for  using  the  new  technology 

Information  not  provided 

Application  scenario: 

provide  one  or  more  examples  of  use,  focusing  on  the  clinical  environment,  when  appropriate 

GME  (Residency  Requirements),  CME  (Distance  learning,  continuing  education), 
True  telemedicine  for  diagnostics,  management  and  follow-up. 

List  sites  at  which  the  technology  will  be  used: 

All  MTFs’  throughout  GPRM  with  BAMC  as  the  center 

Timeline  of  initiative: 

date  work  started,  date  of  first  clinical  use,  date  of ' full  implementation,  anticipated  length  of  project 

Housekeeping  started  in  July  1997 
Accomplishments  to  date: 

100%  Equipment  inventory,  100%  functional  status 
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REL-Technology  Profile 
TELEMEDICINE 


System  components: 

list  hardware,  software,  networking,  telecommunications  requirements) 

1.  NEC 
CLI 

Picture 

Global  Med  -  ATT  has  Store  &  Forward  software 
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REL-Technology  Profile 
TELEMEDICINE 


Telemedicine  Initiative 

Technology  Profile 

To  be  completed  by  the  REL  Team 


MISSION 


(NO  USAGE  LOGS) 


1.  Category  of  Technology 

%  time  used  for  each 

Direct  clinical  care: 

□  diagnostic 

0% 

□  therapeutic 

0% 

□  preventive 

0% 

Non-clinical  use: 

□  administrative 

0% 

□  education/training 

0% 

□  health  promotion 

0% 

□  logistical 

□  marketing/improve  morale 

2.  Application  Environment 

Combat  casualty  care 

□  reduce  battlespace  deaths(KIA) 

□  reduce  evacuations 

□  reduce  combat  stress 

Keep  AD  forces  on  job 

□  disease  management  (DNBI)  (deployed) 

□  disease  management  (DNBI)  (sustaining  base) 

□  Preventive  (deployed) 

□  Preventive  (sustaining  base) 

0% 

□  Humanitarian  assistance  (non-DOD  beneficiary) 

□  Sustaining  base  (beneficiary  care) 

_ 0% _ 

□  Reduce  MHSS  skill  mix  and  staffing 

0% 

□  Reduce  health  service  requirements  of 

TRICARE  support  contractors 

□  Keep  beneficiaries  at  work  or  home 

0% 
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REL-Technology  Profile 
TELEMEDICINE 


3.  End  User 

□  Individual 

□  Combat  arms  _ 

□  Combat  service  support  _ 

□  Unit  (Echelon  1-2)  _ 

□  Unit  (Echelon  3-4)  _ 

□  Sustaining  base  (Echelon  5,  CONUS)  0% 

4.  Role  of  AMEDD  in  this  initiative 

□  Researcher 

determines  fundamental  knowledge  related  to  the  scientific  or  engineering  field  being  investigated 

□  Developer 

solves  technical  and  engineering  problems  related  to  the  production  of  the  finished  product 

□  Systems  Integrator 

combines  products  from  multiple  sources  intoa  unique  product,  may  add  proprietary  hardware  or 
software  to  system 

□  Evaluator 

conducts  or  participates  in  clinical  or  technical  trials,  including  usability  testing 

□  Advisor 

provides  clinical,  military,  or  technical  expertise  to  developers 

□  None 

5.  Initiative  Driver 

□  Investigator-initiated  (investigator  academic  or  clinical  interests) 

□  Centrally  directed  (USAmrmc,  dod-ha,  amedd  c&s,  etc.) 

6.  How  is  access  to  the  initiative  determined? 

What  patients  and  providers  participate?  How  are  they  selected? 

Follows  customary  referral  paterns  (PCMtt  Specialists) 

7.  Customer  base 

number  of  users  _ 

number  of  units/devices  20+ 

number  of  uses  per  time  unit  _ 

number  of  units  in  use  now  ? 

total  number  of  units  needed  _ 


8.  Market  penetration 

Uses  of  the  technology/total  incidence  or  number  of  uses 

one  year  ago 
today 

one  year  from  now  (estimated) 
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REL-Technology  Profile 
TELEMEDICINE 

MATURITY 

9.  Technology  Sources 

list  all  that  apply 

Non-developmental  item 

□  commercial  off-the-shelf  (COTS) 

□  government  of-the-shelf  (GOTS) 

Developmental 

□  enhanced  (customized)  GOTS/COTS 

□  custom  (“one-off,”  finished  product) 

□  prototype  (as  a  phase  of  development) 

10.  Integration  with  existing  IM/IS  infrastructure 

□  Yes 

□  full  functionality 

□  demonstration  mode  only 

□  No 

11.  Anticipated  time  to  mainstream  acceptance  and  use 

□  Today  (1997-2000) 

□  Transition  (2000-2007) 

□  Force  XXI  (2007-2017) 

□  Army  After  Next  (2017-2025) 

□  Army  of  the  future  (beyond  2025) 

12.  Barriers  to  entry 

□  development  cost 

□  unit  cost 

□  complexity 

□  physician/provider  resistance 

□  patient  resistance 

□  immature  technology 

□  competing  product  or  practice 

13.  FDA  regulatory  status 

□  None 

□  Under  review 

□  501k 

□  PMA 

□  Approved 
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REL-Technology  Profile 
TELEMEDICINE 


PERFORMANCE 

14.  Describe  the  system  components  (see  attached  sheets) 

model,  peripherals,  software  version,  weight/cube,  power  requirements,  MILSPEC, 
etc. 

Hardware:  CLI  Radiance,  document  camera,  NEC,  no  peripherals, 
Picture  Tel,  no  peripherals 

Software:  Global  Med  -  system,  House  Call  -  custom  software 

Networking:  ISDN,  Video-conerencing,  Frame-relay  &  packet  switching 
(provided  by  Med  Net) 

Telecommunications: 

Primary  Video  Conferencing  with  some  Telemedicine  and 
Teleradiology 


15.  What  data  fields  are  :  Information  not  provided 

acquired: 

transmitted: 

archived: 

16.  How  is  data  transmitted?  ISDN 

17.  What  are  the  bandwidth  requirements?  From  112Kbs  to  1536Kbs, 
application  dependent 

18.  What  data  standards  are  currently  used?  Packet  switching  &  Fame  relay 

(e.g.,  HL7,  DICOM.  TCP/IP,  H32x) 

19.  What  is  the  system  load  ?  Varies 

(frequency  of  use,  time  per  use) 

20.  How  is  integration  with  existing  IM/IS  resources  achieved?  Use  of 

Med  Net,  shared  personnel  with  BAMC 

21.1s  the  system  used  in  a  clinical  evaluation  process?  NO 

22.1s  the  process  approved  by  a  duly  constituted  institutional  review 
board?  NO 
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TELEMEDICINE 

RELIABILITY 

23.  What  is  the  reliability  level? 

number  of  times  use  is  successful/number  of  times  use  attempted 

One  example  is  Telepsychology,  12  attempts-no  success 

24.  What  are  the  service  requirements?  Cross  platform  incompatibility  and 
audio  but  no  video  a  problem 

routine: 

unscheduled: 

25.  What  personnel  are  allocated  to 

system  administration:  One  FTE  Contractor,  One  GS1 1@  V2  time.  One  Army  LTC(p), 
Medical  Corps  (full  time  Physician) 
technical  service  support:  Vendor  contracted 

26.  In  what  environments  is  the  system  designed  to  operate? 

In  Hospital  setting 

27.  In  what  field  environments  has  the  system  been  tested? 

None 

28.  What  training  is  required  before  using  the  system? 

5th  Floor  &  Downstairs  VTC  Room  -  first  couple  times  user  is  trained  to  set- 
and  operate  independently. 
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Mission 


Fort  Hood  Medical  Activity  (MEDDAC)  with  its  mtlitaiy,  civilian,  and  volunteer 
personnel,  operates  an  integrated  health  care  system  providing  clinical  and 
preventive  service*  in  support  of,  and  responsive  to,  the  largest  military 
installation  in  the  Department  of  Defense.  We  educate  and  train  medical 
personnel  to  a  continual  state  of  readiness. 

Damall  Army  Community  Hospital  (herein  referred  as  Damall)  is  composed  of  a 
staff  of  over  1,700  health  professionals,  dedicated  to  providing  high  quality 
medical  care  who  perform  almost  one  million  outpatient  visits  annually.  Damall 
has  a  substantial  interest  in  the  Central  Texas  Region  with  the  responsibility  of 
.  providing  the  best  possible  health  care  services  to  over  40,000  active  duty 
military  members  and  their  more  than  70,000  family  members.  Damall  has 
twelve  Troop  Medical  Clinics  (TMC’s)  located  on  Fort  Hood  for  treatment  of 
active  duty  soldiers,  and  three  off-post  health  care  clinics  which  provide  medical 
care  In  a  family  practice  setting. 


Vision 


Over  the  last  three  years,  Damail  has  propelled  itself  into  the  prominent  role  of 
being  recognized  as  a  leader  in  telemedicine  within  the  U.S.  Army  Medical 
Department  Our  objective  at  DamaK  is  to  continue  in  the  pursuit  of  the 
“HOSPITAL  WITHOUT  WALLS"  concept  Opportunities  abound  by  utilizing  tete- 
consuttation  to  conduct  a  broad  spectrum  of  clinical  encounters  without  the 
simultaneous  physical  presence  of  both  provider  and  patient  In  the  same  place. 
Telemedicine-consultation  will  provide  medical  center  expertise  to  the 
beneficiaries  of  Fort  Hood  as  though  a  medical  center  was  located  here.  Via 
talemedidne  a  provider  elsewhere  "seas*  the  pedant  at  Damail  whan  the 
expertise  is  not  available  locally.  Individual  objectives  are  listed  in  the 
“Objectives  and  ‘Capital  Requirements'  sections. 
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Background: 


In  October  1 994,  a  strategic  planning  conference  was  held  with  key  staff 
members  of  Damall  and  Brooke  Army  Medical  Center  (BAMC).  At  that  time 
BG  Claypool  presented  h»  vision  of  creating  a  ’hospital  without  wails’  that 
would  be  connected  through  telemedicine  to  create  a  seamless  health  care 
facility.  This  concept  was  immediately  seized  by  the  leadership  of  Damall, 
culminating  in  a  proposal  to  develop  an  iDNX/digrtal  switching  network.  The 
network  would  operate  on  a  T-1  backbone  and  employ  either  RctureTEL  or  CLI 
TVCs  (based  on  application). 

Simultaneously,  BAMC  consulted  with  various  vendors  and  visited  Texas  Tech 
University.  Ultimately  it  was  decided  to  employ  seven  point-to-point  T-1  lines 
between  Damall  and  BAMC  that  could  be  manually  switched  If  the  need  arose  to 
talk  to  someone  other  than  the  person  you  were  hardwired  to.  Twenty 
customized  NEC  TVC  carts,  approximately  6.5  feet  tali  with  dual  monitor*  were 
procured,  ten  for  each  site.  This  system  was  operational  from  April  1995  to 
March  1 996  with  51  drops  located  throughout  Damall  and  29  drops  throughout 
BAMC  from  which  telemedidne  or  teleconferencing  could  be  conducted.  This 
system  was  phased  out  in  April  1996  when  BAMC  moved  to  their  new  facility. 

Damairs  intent  was  to  become  the  vanguard  of  Information  technology  in  Great 
Plains  Regional  Medical  Command.  With  a  growing  beneficiary  population  due 
to  the  Army's  execution  of  the  Base  Realignment  and  Closure  Act  (BRAC),  this 
already  taxed  MEDDAC  made  the  decision  to  leverage  technology  through  the 
deployment  of  telemedidne. 

Progress  proceeded  by  maintaining  a  global  perspective  on  the  benefits  and 
potential  of  tetemedidno  while  maintaining  a  pulse  on  the  opportunities  available 
in  the  Central  Texas  Region.  This  perspective  led  to  the  development  of  a 
myriad  of  projects  which  today  are  at  various  stages  of  completion. 

Now  we  are  at  a  point  to  look  beyond  the  ■background*  and  transcend  to  the 
future  through  the  utilization  of  telemedicine  to  create  a  virtual  “HOSPITAL 
WITHOUT  WALLS*.  A  more  in-depth  description  is  contained  in  the  following, 
‘Objectives*  and  “Capital  Requirements*  sections. 
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objectives: 


The  ten  objectives  of  the  Oamall  telemedicine  program  are: 

1 .  DamaH  /  Texas  A&M  GME  Conference  System 

2.  Leadership  Video  Conferencing  System 

3.  Satellite  C-Phone  Interface 

4.  Family  Care  Clinic  Remote  Diagnostic  System 

5.  Digitized  Telephone  Switch 

6.  Personal  Communication  Network 

7.  Teleradiology 

8.  Telepathology 

9.  Advanced  Warfighting  Exercise  (AWE) 

10.  NOD-Wlfferf  Hall-8AMC  Connectivity 


1.  Daman  /  Texas  A&M  GME  Conference  System:  In  May,  1996  DamaH 
connected  via  a  T-1  line  to  Texas  A&M  University's  Health  Science  Center 

(HSC).  Damairs  affiliation  with  Texas  A&M  University  is  In  support  of  the 

Psychiatry  Department  Graduate  Medical  Education.  The  connection  to  Texas 
A&M  Is  connected  directly  to  the  Trans  Texas  Video  Network  (TTVN).  The 
TTVN  has  allowed  Damall  to  gain  access  to  the  Texas  A&M  network  which  is 
connected  to  over  90  educational,  research,  and  medical  facilities  throughout  the 
state.  Future  plans  call  for  a  connection  into  our  Deputy  Commander  for  Clinical 
Service  (DCCS)  Conference  Room  and  the  purchase  of  a  V-TEL  conferencing 
unit.  Once  fielded,  the  access  offered  by  the  TTVN  will  be  taken  advantage  of  to 
the  maximum  extent. 


2.  Leadership  Video  Conferendno.Sv5.tem:  A  desktop  video  conference 
system  (C-Phone)  has  just  been  installed.  Desk-top  video  conferencing  Is  a 
means  for  two  or  more  personnel  to  be  audic/vfsualfy  connected  through  their 
existing  computer  monitors.  C-Phone  will  complement  teleconsultation- 
consultation.  This  system  will  allow  a  limited  number  of  key  hospital  personnel  lo 
conduct  video  conferencing,  attend  meetings  via  remote,  or  report  on  important 
events  to  the  hospital  commander  or  chief  of  staff.  C-Phone  Is  currently 
connected  to  administrative  division  chiefs  and  future  plans  are  to  connect  the 

clinical  chiefs. 
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Upon  completion  it  will  give  us  the  ability  to  conduct  video  conferencing  utilizing 
both  desktop  and  group  oriented  video  conference  systems. 


3.  Satellite  C-Phons  interface: 

Fielding  of  C-Phone  devices  to  satellite  buildings  will  reduce  the  time  key 
personnel  are  away  from  their  desks  or  area  of  responsibility.  As  a  cost  effective 
means  of  reducing  travel  finis,  C-Phone  will  be  installed  in  Managed  Care 
Division  (Building  36019);  Department  of  Readiness.  Education,  Training,  and 
Education  (DRETS);  and  Personnel  Division  (Building  36001).  Additionally  a 
“proof-of  concept"  of  connecting  C-Phone  to  our  three  down-town  clinics  will  be 
tested. 


4.  Family  Care  Clinic  Remote  Diagnostic  System: 

a.  A  myriad  of  services  are  envisioned  for  the  following  three  dinlcs:  The 
Adult  Chronic  Care  Clinic  (AC3),  Killeen  Family  Cara  Clinic  (K-FCC),  and 
Copperas  Cove  Family  Care  Clinic  (CG-FCC),  Recently  a  T-1  was  Installed 
between  the  AC3  and  Damall.  This  is  being  utilized  as  a  “backbone"  for.  point- 
to-point  telemedicine  between  our  Chief  of  Department  of  Medicine  and  the  AC3 
Chief,  CHCS,  and  for  the  pending  installation  of  the  Integrated  Finandai  Control 
System  (IFICS).  Telemedidne  will  be  conducted  over  a  CU  TVC  provided  by 
MEDCOM. 

b.  Telemedidne  is  also  planned  at  K-FCC  and  CC-FCC.  In  an  effort  to 
contain  cost  and  maximize  existing  resources,  NEC  carts  purchased  by  BAMC 
for  the  initial  Damall-BAMC  project  will  be  utilized.  Currently  we  are  in  a  "proof- 
of-concept*  test  utilizing  a  NEC  at  each  dinic  connected  through  a  WAN  server 
to  see  if  it  can  successfully  transmit  through  a  C-Phone.  Additionally,  Damall  ia 
looking  at  ways  of  minimizing  the  transfer  of  hard  copy  information  by  courier 
between  three  clinics  and  the  main  hospital.  For  example,  an  Elmo  EV-X 
film-to-video  converter  is  being  reviewed  that  would  allow  the  transmission  of  a 
digitized  image  to  our  Radiology  Department  where  it  would  be  read 
instantaneously  and  the  results  electronically  transmitted  to  the  provider.  Clear, 
tangible  benefits  would  be  derived  from  such  a  system:  reduction  of  courier 
service,  minimized  risk  of  loss  data,  foster  diagnostic  treatment  by  the  provider, 
all  to  the  benefit  of  the  patient. 
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5.  ninitized  Teleohona_Switch: 


The  hospital  switch  is  now  filled  to  capacity  with  respect  to  trunks  {common  user 
access  into  and  out  of  the  hospital),  so  adding  more  without  an  upgrade  is  not  an 
option.  We  are  also  the  only  Command  on  Fort  Hood  that  is  not  capable  of 
Integrated  Services  Digital  Network  (ISON).  We  are  currently  looking  at 
upgrading  this  aging  SL-1  telephone  switch  with  ISDN  capability  and  additional 
trunking  to  handle  the  Increased  calling  population.  Our  proposal  a  to  go  with 
an  Option  61  switching  system  equipped  with  1 800  voice  lines  and  ISDN,  using 
entirely  digital  telephone  sets.  The  existing  automated  attendant  and  voice  mail 
system  would  be  incorporated  into  the  upgrade  switch. 


6.  Personal  Communication  Network: 

a.  A  wireless  phene  system  is  to  be  provided  to  key  hospital  personnel.  A 
wireless  phone  has  many  advantages  over  a  cellular  phone  and  thus  eliminates 
the  need  for  cellular  phones  and  beepera/pagere  normally  associated  with 
working  in  the  hospital  environment  A  wireless  phone  system  differs  in: 

1.  No  air  time  charges.  It  Interfaces  with  the  host  telephone  system  to 
process  and  manage  telephone  traffic. 

2.  No  static,  fading,  or  dead  zones.  The  signal  Is  carried  from  one  base 
station  than  handed  to  another . 

3.  No  eaves  dropping  by  tuning  into  the  call.  It  also  has  the  same 
features  as  you  office  telephone,  in  fact  they  can  share  the  same  number.  Caller 
ID.  call  forward,  conference,  and  voice  mail  with  message  waiting  indication  are 
all  features  available  on  a  wireless  phone. 

4.  No  running  out  of  power.  Most  will  operate  8-10  hours  on  a  single 
battery  charge  verse  4-6  on  most  cellular  phones, 

b.  By  employing  wireless  telephones  will  expect  to  Improve  coordination 
throughout  the  staff  and  develop  a  faster  response  time  to  situations  as  they 
arise.  It  will  also  allow  instant  access  to  information  which  should  result  in  fewer 
errors  and  streamline  operations  by  freeing  up  additional  time  required  to  find  a 
phone  to  answer  pages,  etc.  The  goal  Is  to  call  a  person  and  not  a  place,  to 
have  one-phone  and  one-phone  number  for  the  duration  of  an  assignment  at 
Damall. 
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7.  Telaradiolopy: 


A  film-less  radiology  system  is  being  planned  by  Darnell.  A  MEDCASE  is 
submrtted  for  a  FUGI  Computed  Radiography  AC-3CS  System  for  digital 
radiography  pictures  It  will  complement  teleradiology-consultatlon  by  allowing 
practitioners  to  examine  patients  at  the  Troop  Medical  Clinic  (TMC),  then 
forwarding  rapidly  displayed  images  to  diagnostic  workstations  at  the  Radiology 
Clinic  at  the  hospital.  Once  at  the  hospital  they  will  be  Interpreted  and 
transmitted  back  to  the  TMC.  It  replaces  film  and  screens.  It  will  also  save 
precious  man-hours  by  preventing  travel  by  the  soldier  to  the  hospital  and  the 
subsequent  delays  In  awaiting  interpretation  of  results.  It  will  also  allow  soldiers 
to  remain  with  their  unit,  where  they  are  most  needed. 


8.  Tetepathology: 

Darnall  has  the  capability  of  transmitting  or  receiving  pathology  lab  images  to 
the  Armed  Forces  Institute  of  Pathology.  This  is  accomplished  with  a  Roche 
imaging  system  over  twin  56Kbs  lines.  However,  utilizing  56Kb*  lines  results  In  a 
very  slow  download  time  for  images.  Darnall  envisions  sending  tissue  results  or 
receiving  results  from  a  consortium  of  medical  facilities.  This  would  be 
accomplished  with  an  IDNX/Teleos  network  over  a  T-1  line,  thereby  greatly 
speeding  the  image  transmission.  This  will  enable  each  facility  to  draw  upon  the 
vast  expertise  at  other  commands,  and  would  be  available  to  any  site  with  a 
digital  teiepathology  system  utilizing  industry  H.320  Standards. 


9.  Advance  Warfiahtlnq  Experiment  fAWFl: 

Damail  will  provide  Level  V  teleconsulatlon  support  of  the  97-02  Task  Force  XXI 
AWE.  The  AWE  is  scheduled  for  March,  1997  at  Fort  Irwin,  California  and  is  in 
support  of  the  Experimental  Force  (EXFOR)  of  the  4th  Infantry  Division 
(Mechanized).  Currently  we  are  coordinating  with  C  Company.  4th  FSB  who 
use  a  satellite  based  telemedicine  system  verse  Damall's  T-1  land-based 
system. 


ID.  NOD  -  Damail  -  Wilford  Hall  -  BAMC  -  Region  6  Teleconsultation. 

a.  Damail  Is  connected  to  the  Great  Plains  Regional  Medical  Center  via  a 
standard  58  Kbs  line  using  a  PtotureTEL  TVC,  This  system  will  be  used  for  both 
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leadership  training  by  the  GPHSSA  and  in  the  overall  management  of  TRI  CARE. 

b.  Prior  to  BAMC  moving  to  their  new  location,  we  had  experienced 
successful  medical  interaction  between  ten  (10)  of  our  dlnics  and  their 
counterparts  at  BAMC  utilizing  NEC  TVCe.  During  BAMC'a  transition  to  tha  new 
hospital  we  currently  have  a  direct  T-1  connection  from  our  DERM  Clinic  to  their 
DERM  Clinic.  We  also  have  connectivity  to  the  Wiiford  Hall  NICU  from  our  NICU 
via  a  dedicated  T-1. 

c.  Damall’s  plan  is  to  link  the  main  hospital  (Building  36000)  to  both  Wiiford 
Hall  and  BAMC.  This  wBi  be  made  possible  by  employing  a  Teleos  200  switch, 
IDNX  90  multiplexer  and  a  DS-3  data  line  through  the  Network  Operations  and 
Deployment  (NOD)  Center.  The  NOD  uses  a  multi-point  control  unit  as  their 
gateway  to  other  medical  facilities.  Connecting  these  facilities  will  allow  divergent 
facilities  with  divergent  staff  to  optimally  work  together,  thereby  increasing 
access  to  health  care  while  decreasing  costs.  This  new  system  will  further  the 
“hospital  without  walls*  concept 

Alt  of  these  Initiatives  will  be  diligently  persued  with  the  overall  objective  of 
improving  the  health  of  our  beneficiaries. 
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Capital  Requirements: 


To  implement  our  plans  we  require  an  investment  totaling  1 .214  million  dollars 
for  the  following  purposes: 

1.  DamatliTexas  A&M  GME  Conffipgpdnc  System  -  8SK 

sl  85K.  Provide  additional  VTEL  conferencing  equipment  to  our  DCCS 
Conference  Room. 

b.  1GK.  Wiring  infrastructure. 

2.  Leadership  Video  Conferencing  System  =  45K 

a.  30K.  Provide  desktop  video  conferencing  capabilities  to  8  additior  al 
locations  within  the  immediate  area  of  the  hospital. 

b.  15K.  Wiring  infrastructure  and  additional  muiti-polnt  control  unit. 

3.  Satellite  C-Phone  Interface  =  97K 

a.  47K.  Engineer  and  install  an  interface  gf  our  C-Phone  system  into  the 
projected  TELEOS/IDNX  telemedicine  network. 

b.  30K.  Provide  desktop  vidao  conferencing  capabilities  to  3  additional 
locations. 

c.  20K.  Wiring  infrastructure. 

4.  Family  Care  Clinic  Remote  Diagnostic  System  -  37K 

a.  15K.  T-1  installation  to  K-FCC  and  CC-FCC. 

b.  7K.  Two  additional  desktop  video  conferencing  units. 

c.  5K.  Radiology  film-to-video  converter. 
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d.  10K.  File  server. 


5.  Digitized  Telephone  Switch  =  722K 

a.  722K.  Hardware  upgrade  to  Option  81  and  software  upgrade  from 
release  19  to  20.  2,000  lines  with  ISDN  equipment 

6.  Personal  Communication  Network  =  107K 

a.  107K.  Wireless  phone  system,  base  station,  engineering  analysis, 
500  telephones,  Installation,  warranty. 

7.  Taleradioloov  -  Researching  cost  at  this  time. 

8.  TaleoatholoQV  *  10K 

a.  10K.  T-1  Line  and  infrastructure. 

8.  Advanced  Warftahting  ExercisefAWEl  =  10K 

a.  5K.  Fairchild  RF  Modem. 

b.  5K-  AppleTalk  Router. 

10.  NOD-Wflfhrd  HalLBAMC  Teleconsultation  ■  111K 
a.  137K.  Teleos  200  Digitized  Switch. 
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Cuatomer/Patient  Profile 


In  the  medical  field,  it  has  been  common  practice  for  health  care  providers  to 
seek  additional  consultative  expertise,  refer  patients  to  other  locations,  and  send 
supporting  treatment  information  (medical  records,  x-raya,  lab  images  etc)  via 
local  and  long  distance  postal  services,  military  runners  or  dispatchers.  Virtually 
all  of  our  customer/patients  will  derive  benefit  from  telemedicine  by  transporting 
medical  information  (rather  than  paper)  to  the  soldier  rather  than  bringing  the 
soldier  to  the  information. 

DamaU  patients  include  active  duty  military  personnel,  reserve  military  personnel, 
retired  military  personnel,  and  dependents  of  eligible  military  personnel.  DACH 
has  the  responsibility  of  providing  the  best  possible  health  care  services  to  over 
40,000  active  duty  military  members  and  their  more  than  70,000  dependants. 
Daman’s  patients  range  In  age  from  the  newborn  to  the  aged.  They  come  from 
surrounding  communities  throughout  Central  Texas. 

Marketing  Plan 

Responses  from  users  of  our  existing  telemedicine  systems  and  video 
conferencing  systems  indicate  that  the  service  is  enjoying  an  excellent  reputation 
and  we  fully  intend  to  continue  this  trend.  Relationships  with  Texas  A&M,  Scott 
&  White  Hospital.  Olin  Teague  Veterans  Hospital,  in  conjunction  with  our  military 
affiliations,  substantiate  the  fitness  of  Damail  Army  Community  Hospital  for 
considerable  growth  and  accomplishment  In  the  telemedicine  arena- 

Damail  Army  Community  Hospital's  strategy  is  to  aggressively  enhance,  promote 
and  support  the  fact  that  our  customers  are  our  priority  and  we  must  utilize 
technology  (of  which  telemedicine  is  showcased)  as  it  becomes  available  to 
maintain  our  position  as  the  leading  health  care  provider  in  Central  Texas. 


Conclusion 

The  "state-of-the-art"  technology  being  employed  In  the  form  of  t*l^lidne 
throughout  the  work!  Is  creating  a  paradigm  shift  in  health  care.  Today, 
telemedicine  touches  every  comer  of  our  organizational 
business  practices  of  sharing  information  between  ®  rd 

saving  neonatal  procedures.  These  efforts  are  an  important  step 
producing  a  seamless  network  of  patient  care  among  OamaH  and  ^  mlfitoy  and 
dvitian  affiliates.  As  our  active  duty  population  decreases  it  *  p 

our  soldiers  on  the  job.  Our  goal  la  to  move  information  instead  of  people- 


An  International  T cleniedicinc  Networ 


DoD  Health  S^t'Vkn  Region  VI 
Telemedicine  IHlot  Project 

A  vKfcchiokxonfcrtftcmg  based  network  Tor  DoD  Region  V[  to  support  th«  development  *nd  delivery 
0^  Iteahb  care  over  long-disonoe,  lotegrtling  all  aspect*  of  telemedicine  mco  a  single  regionally  baaed 
comniuidcanona  infnurtruc tore.  The  TKiCARH  Southwest  Telemedicine  Pilot  Project  if  an  approved  DoD 
(Health  A/tlinf }  MHSS  Proponent  Commit!  ce,  Proof -of -Concept  project  in  Tdeconsultatica  initialed  within 
DoD  Region  VI  to  evaluate  the  concept  of  uriluing  vkteo^elcconfcTcncing  (VJC)  to  support  the  delivery  of 
health  cere  over  long-distance  by  providing  medical  expertise  to  underaorved  military  treatment  facilities  within 
the  region. 

DoD  Region  VI  coven  Oklahoma,  Arkansas,  and  major  portions  of  Texas  (defined  tts  Eastern  Texas)  *thi 
Louisiana  (defined  as  Western  Louisiana).  Do D  Region  VI  was  geographically  configured  around  two  military 
medical  centers  to  ensure  regional  access  to  tertiary  cure:  Wit  ford  Kali  Medical  Center  (WHMC)  and  Brooke 
Army  Medical  Center  (BAMO,  to  provide  health  care  to  a  beneficiary  population  of  around  qm  million. 
WHMC  flMCliOfti  as  the  Lead  Age*f  and  focal  point  for  health  services  planning  within  the  region. 

The  region  mdwfc*  a  mixture  of  Army,  Air  Force,  Navy  and  USTF  medical  facllltlok  Army  MTFs  t  odudt 
one  Army  Medical  Center,  and  three  Army  Hospitals.  Air  Force  medical  assets  include  one  Air  Force  Medical 
Center,  eight  Air  Force  HotptaU  and  five  Air  Force.  Clinics.  One  Navy  Hospital  and  three  Branch  Clinics  arc 
also  located  tn  the  Region. 


The  punnet  of  this  project  Is  to  introduce  telemedicine  technology  into  dully  practice  aivd  training 
for  provider*  n  Region  VI.  To  this  end,  the  project  will  evaluate  Telemedicine  as  the  vehicle  for  improving  the 
regional  referral  process.  The  goals  of  the  TRICARE  fiouthwsa  Telemedicine  Piiui  Project  are: 

{ I )  improve  access  and  quality  at  mr*J  hmms, 

(2)  increase  beneficiary  and  provider  satisfaction  with  health  care  delivery. 

L3Jj*gparc  providers  for  support  of  depkryed  force**  via  telcconoullmg, 

and  integn ate  the  regional  MTF  referral  process  and  facilitate  c ross  service  Trftrrals 
i?)  be  coat-efTecrive  or  cost-neutral. 


Dbhrag^oru  Talamadicirt*  uses  an  interactive  video  system  in  Learned  with  biomedical  telemetry,  it  allows  a 
p+iysroan  at  a  specialty  medical  complex  or  teaching  hospital  to  examine  and  treat  patient*  «  multiple  ^aicliilc 
location*  such  os  rural  hospital*  and  clinic*.  Integrated  into  the  video  system,  and  based  on  ibe  requirements  of 
the  remote  medical  facility,  ire  «  numhtr  of  diagnostic  devices.  The  remotely  cofUf oiled  examination  comers 
Lw  s  powerful  xoom-focus  capability  that  allows  a  dcrmaiotof  itt  to  examine  small  details  of  a  paiicm's  skm. 
An  electronic  stethoscope  permits  &  cardiologist  to  do  a  complete  cardiological  examination.  Specific  camera 
adapters  and  resolution  capabilities  enhanced  by  remote  controlled  optic*  provides  an  ophthalmologist  u  clear 
view  of  the  retina  of  a  patient  ai  ihe  referring  site.  A  specialist  can  review  any  type  of  X-ray  examination 
including  an  MR!,  CAT  scan  or  ultrasound. 


Specialise  at  the  medical  center  can  evaluate  partem*  xi  the  wma  time  a*  primary  care  physicians,  who 
nxeive  interactive  educational  input.  The  educational  lav^L  of  pnrrjjry  cam  physician?  improvpd*  enabling 
them  to  handle  men*  oomp(«x  problems  «nd  inons  appropriate  Utilization  of  apccialisu.  Thu  is  1  concept 

campierncnu  Lhe  prunaiy  c&ic  management concept  of  TRlCAflk.  The  telemedicine  system,  by  reducing 

the  need  to  trantfer  a  patiaat  maintain*  cortbuicy  of  exre  between  ihe  patient  and  the  primary  care  physician,  U 
a  pattern  docs  need  to  be  transferred,  the  primary  care  physician  can  he  updated  daily  over  the  telemedicine  link. 
Once  Lh»  patient  U  discharged  from  the  reTerraJ  facility,  tho  specialist1*  follow-up  care  of  ihe  patient  also  is 
facilitated  by  using  the  system,  without  the  inconveoictKc  of  distant  travel  by  the  pa dene 

A  wlcmedicino  system  thus  provide*  immediate  access  to  quality  hull heart  It  resolve*  th»  probfemt 
inherent  in  our  existing  system  Of:  geographic  or  socioeconomic  isolation  fur  iha  patieot;  pruicsxional  isolation, 
far  the  provider;  escalating  costs;  inappropriate  utilization;  lots  of  continuity;  and  ineffective  CM E, 

A  tdcmadictne  system  must  provide  u.  complete  jet  of  clinical  information  about  a  patient  to  the 
pftyrician/ipcctiriixt  in  renl  time.  This  no<  only  involves  information  sent  from  the  clinical  nciting  to  llw 

aUo  rcquirgthanig^pfiyMcian  be  able  to  access  iitlbn nation  about  the  puiictu  s 

c  urrent  and  past  medical  condi  ni>Ii  Ja  A  lime1  JtV5"SP^e  Thdgperidfliif  {ftgjrr"" - - - ^ 

The  high  and  dynoiruc  llc^lbll  Ity  ©i  tETSclterJ cociinuinicitien  protocols  {OC-3,  DS3,  TU 
bisrulwulth-on-dcaMUMi  technology  (ATM),  and  DICOM  s temteid  for  medical  information  interchange)  support 
the  neecatary  mix  of  multi  medth  information  in  a  tuufWd  and  clinically  useful  manner,  Live  teleconferencing, 
requiring  moderate  bandwidth*  Oft  a  continuous  basis,  is  integrated  with  patient  vital  signs  (low  bandwidth  data, 
bursty  and  continuous  to  provide  the  physician  with  a  “telepresence1*  to  the  patient 

Telemedicine  offer  benefits  to  key  uakaholdcra  in  the  health  care  system:  (1 )  Fatioib  benefit  from 
improved  access  to  specialty  cars;  reduced  transportation  and  hospitalization  costs  as  well  as  decreased  stress  - 
associated  with  traveling  long  distances  in  a  specialty  cait:  facility;  increased  continuity  of  care  as  a  result  of 
remaining  at  the  primary  care  provider's  facility  ;  increased  quality  of  care  through  specialist  consultation  and 
immediate  attention  ta  potentially  life* threatening  cooditioftl,  f2>  Pro vi den  experience  reduced  professional 
isolation:  improved  continuing  medical  education  through  such  applications  as  distance  learning  and 
videoconfereacir^  and  (3)  Health  Cart  Facilities  benefit  from  improved  ability  to  attract  and  retain  highly 
qualified  health  care  professionals;  and  increased  market  share  a*  well*.  improved  efficiency  by  virtue  of  the 
abii  iry  to  provide  a  full  spectrum  uf  strvica*. 

TrifigWflda*  PPEfflMifo*:  Telemedicine  opportunities  cm  be  broken  down  into  two  broad  categoric: 
Doctor* to- Doctor  or  Doctor- to- Fat feet 

Doctor'll^ Doctor  includes  transmission  of  medic*]  records,  transmission  of  medical  images,  video 
coosaiiatiom;*  continuing  mixtiod  education  u:liaTdiology/telccarthtvlogyAelepathok>gyt  multimedia,  electron  re 
data  intcrchanga,  rvfes-b**cd  messaging, 

Doctor-te*Fatfeot  includes  remote  potiertf  monitoring,  delivery  of  health  infomtation,  vtqfeo 
com  ul  lotions. 

F-fPiect  Proposal  Dwcrfmloti;  The  long  term  vision  of  the  Telemedicine  Project  will  be  to  integrate  the 
untiairvM  m  taUradlofogy^  teledentlairy,  lcte~educatiua,  tetepmtiKdogy,  and  tdccouauiution  (both  peacetime  and 
cotrtingcocy  support)  Into  one  regionally  integrated  network.  These  components  oftekmedicine  can  all  use  the 
^uoc  communication  infraoructure.  This  communication  network  must  be  capable  of  I utn tiling  the  trarc$nii**iun 
ijydwidA  requirement*  erf  telocoiudbng,  tcfcredickjgty,  t*lep«hoJo»r,  and  video-tdecon/creTtcine.  The 
rcqwtowTtfi  for  bsraiwkltti  range  from  low  to  high  oo  a  continuous  basax  and  sometimes  in  bums  for  some 
■pplkatioos  (image  and  data  exchange).  The  technical  task  force*  in  collaboration  with  AT  AT  through  the 
Defense  CoonicrcUl  Telecommunications  Network  ODCTN)  contract  will  refine  the**  oommumcaiiocu 
requirements  and  develop  the  communication  infrastructure  ax  pan  of  the  final  telemedicine  plan. 

The  plan  is  to  have  Utis  not  weak  organized  to  function  as  a  comprehensive  system  fnr  the  whole  region, 
creating  a  “virtual  health  care  delivery  system*.  It  will  incorporate  new  techacJogicj  such  a*  digital 
corn  press  inn,  sioreanti  forward  yfciragjiatcd  madStfrccord.  EMAIL,  end  computet*.  II  should  improve 

subepedaUy  coruuWionrBEen'lM.  luou,  end  kupirtpnysictirtzillcau^  * 

Ffftiwt  DcrdonmttX  AgBESftSht  ^  project  ww  developed  ami  requirements  determined  by  a  task  forcr 
approach  (a  clink*]  task  force,  an  administrative  task  force  and  a  technical  task  force)  in  a  collaborative 
«flviToain«tu  bd woes  Service*  <  An  executive  teak  force  provided  oversight  and  integration  of  the  ihrcc  usk 


force*,  which  wW  eo-chaired  by  ihc  EhtKtitirc  Director  and  Medical  Director  of  TRICARE  Southwest.  The 
li$k  force*  included  provider*.  administrators,  and  technicians  from  Wtlfcrd  Hell  Medical  Center,  Brooke  Army 
Medical  Center.  AFMSA.  SCHWA,  #ntf  5an  Antonio  Clinics. 

The  clinical  task  force’*  goal  was  to  develop  the  clinical  requirements  for  the  project.  A  trial  w» 
conducted  by  tht*  task  force  utilizing  the  four  leading  vendor*  in  telemedicine  VTC  group  systems;  PTc).  CLt, 
N£C,  end  VTEL.  Desktop  system*  from  TRW  and  the  previously  mentioned  vend  on  were  evnlUAietl  durirtj  tht 
two  weak  trial  between  WHMC  and  BAMC.  The  purpose  of  the  trial  was  two  fold:  first  ro  determine 
transmission  speed*  needed  fee  the  various  spec, aide*  and  which  applications  are  clinically  appropriate  for 
wlecoosulting,  and  second,  which  of  Ihe  various  functionality's  are  needed  for  the  Pilot  Phan*  of  Giif  project 
The  clinical  task  force  also  determined  the  requirements  Tor  diagnostic  device*  required  for  teleconsulutions. 
The  technical  task  force  and  the  contractor  (AT&T)  will  take  the  requirements  developed  by  the  clinical  task 
force  and  turn  them  into  technical  requirement*  for  (lit  telemedicine  system. 


AT&T  look  into  consideration  any  additional  requirements  driven  by  tclcrsdiolojy.  lelo-wJuaititin.  tciedemistry 
and  tdepatboloty .  T*cy  integrated,  where  reaaibte,  (be  requirements  and  develop  the  recommended 
communication  infiaarmemre  and  hardware  requirement*  for  the  entire  telemedicine  system.  Ujejdmiuytmtivc 
taskforqg  was  mpniitifeb  for  the  cstaWishmem  of  policies  and  nrnceiiunm  for  Jte  protect.  Th7s  inciudet\it 
l!!?.  POt  to-  *Chflduling.  medic  ai  record  docmncntalioriTeoH/beoeflt  analysis  (CBA)  plan,  project^* 

^Vfciufttion  criteria*  manpower  support  rayiirerocnu,  arxi  lyucr^idrntninnbUOft 


UWt  During  Project  PevloOTyafc  The  following  war*  50 tm  of  the  muc»i  adtkeued  prior  to 

proj«ci  implementation,  This  list  is  net  meant  to  be  all  inclusive  nnr  in  order  of  importance  or  ehmnological 

ord«.  _ 

M^vclop  evaluation  criteria  fur  the  project 
Determine  MTP  System  configyratiOrt*  in  cdlahontion  with  MYF  providers  and  waff 
Develop  CBA  Plan  and  Model 

Integrate  telemedicine  project  with  outreach  managed  car*  project  (C-21  Managed  C*re  Outreach 
y  Program  -  Flying  physician*  to  remote  MTFs  for  consul  tali  orn) 
vX>cicniuiK  manpower  requirements  for  technkaiJ  support 

^feveiop  referral  guideline*  and  procedures  Sv' — - -  J  ~  ^ 

WS«tenoti»#  procedure*  for  scheduling  teJccoitttilta  lions  y 

'BSennjne  medical  records  documentation  procedure!  / 

ffetermuic  medteal/Uga!  implications  (e.g„  mformed  consent)/ 


Pr°ref,Fl#tl*rt*,i;  The  project's  objective  Ji  to  determine  hyw  end  to  whsrt  extern  the  uic  or  telemedicine 
*S?pli«to«fu  «ffWt  bcccm,  quality,  and  ccks  in  providing  tpeciaity  healthcare'  wrvice*  to  retntt*  location* 
throughout  the  region.  The  administrative  ixik  fevtee  developed  the  evaluation  criteria  to  be  utilised  Tor  the  pilof 
phase  of  the  project  with  input  fmm  the  technical  and  clinical  usk  force.  The  project  include*  evaluation  of  the 
following  key  areas;  u*cr  lalisfaciion.  cost-benefit  impact  on  access  to  care,  and  organization  and  management. 
The  evaluation  criteria  includes: 

0)  As  setting  patient  and  provider  tads  faction  with  telemedicine  consultative  and  technological 

services. 

(2)  Evaluating  the  extent  to  which  telemedicine  improves  diagnostic  accuracy  and  treatment 
cffocii  vends. 

(3)  Determining  the  impact  of  telemedicine  on  mral  beneficiaries  end  provide*  access  to  specialty 

services. 

(4)  Comparing  cost*  «f  utilizing  telemedicine  approaches  to  rural  heaiiiicajre  d*liv«y  with  tnkikronai 
methods  of  meeting  rural  patients*  specialty  needs. 

The  Cost- Benefit  Analysis  (CBA)  Plan  wu  accomplished  by  a  U,S.  AnnyBaylor  Resident,  as  his 
Graduate  Manggwmeai  ftrajatl  completion  of  die  require  men  Li  for  a  Graduate  Degree  in 

Healthcare  Administration  (MHA).  The  CBA  will  be  accomplished  from  October  1 996  -  September  1997  with 
a  final  report  produced  by  the  end  of  calendar  year  i  997.  The  CBA  Plan  bos  bc*ft  accomplished  which  outline* 
the  diia  collection  pnxetlure*  during  the  pilot  period  inti  also  displays  the  baseline  data  collected  for 
comparison  in  the  CBA  report.  The  baseline  data  was  collected  using  FY  1995  as  the  base  period.  The  CBA 
Pfan  shows  the  potential  for  payback  of  the  initial  capital  in vestment  within  three  yean.  The  CBA  repo n  will 
determine  the  overall  cost-benefit  of  ihU  technology  and  specifically  answer  the  question  of  cou-c/Taco  v*n***, 

ggraroinrfcation  Infrastructure:  The  communication  infrastructure  needs  to  be  capable  of  handling  the 
requirements  for  high  speed,  bandwtdth-on-ciemaod  to  support  ail  the  telemedicine  functionalities  mentioned  tit 
ihu  prnpnaai.  W«  m  currently  working  with  the  Defense  Woniuboft  Systems  Agency  (D1SA).  the  Army 
MEDCOM  Health  Care  System  Support  Activity  (HCSSA),  and  the  Triscnrice  Infrastructure  Management 
Program  Office  (TIMPO)  to  develop,  procure,  and  fund  this  comprehensive  commumcaiions  infrastructure, 

Ihrolect  Fffmifemetttatioa:  The  Region  V£  Telemedicine  Project  Implementation  will  b«  phased  in  over  f-2 
years  to  ensure  the  smooth  transition  front  current  practices  to  this  new  advanced  technology  application.  The 
fim  phase  will  be  a  dtoonstnuirm  test  had  for  teiccansultation  and  teleradiology  on  a  small  scale.  This  will 
enable  ut  to  evaluate  the  cost  dTccbveneu  of  the  project  prior  to  foil  regional  ImplcmcntotJOft.  Furthermore, 
this  will  allow  us  to  evaluate  the  administrative  procedures  aod  technological  applications  on  a  much  smaller 
scale  and  make  the  improvements  necessary  prior  to  partial  and  full  implementation  of  telemedicine  throughout 
the  Region. 

Pfaose  It  KJaf  Project 

T t  ftt&ftlUk QtiBtV  The  Pilot  Phase  consul*  of  on  ovaiuariew  period  lasting  *t*  months  to  a  year  and 
indudot  the  following  military  treatment  facilities  (MTF):  Corpus  Chritti  Neva)  Hpipitxi,  Corpus  Chriiti,  TX, 
Goodhritow  Oinfe.  San  Angelo,  TXl  Dyess  Hospital,  Abilene,  TX:  Ft  Polk  Hospital, ! weevil le.  LA.  srui 
Loughlm  Hoepitoi,  f>et  Rio,  TX.  The  test  w,||  utilize  both  of  the  medical  corner*  in  the  Reftom  lirookc  Army 
Medical  Center  (BAMC),  and  Wilfurd  Hall  Medical  Corner  (WHMC),  San  Antonio,  TX  as  the  referral  Ik iliues. 

Qoodfc How  Clinic  currently  refers  over  50  beneficiaries  ft  month  to  the  San  Antonio  Service  Area 
(S ASA).  The  worksheet  botow  is  a  breakdown  of  the  referral*  by  facility  and  specialty. 

LaughJln  Hospital  currently  refer*  over  75  binaficiarie*  a  month  to  the  Son  Antonio  Service  Area 
(SASA).  The  worksheet  below  It  a  breakdown  of  the  referred  by  facility  and  specialty. 

Corpus  Chrini  Navel  Hospital  currently  refer*  ov«r  50  beneficiaries  a  month  to  the  San  Antonio 
Service  Area  (SASA).  The  worksheet  below  l*  a  breakdown  of  the  referrals  by  facility  and  specialty. 

Polk  (Bayne- Junes  Army  Community  Hospital)  currently  refers  over  25  beneficiaries  *t  month  to  ll>c 
San  Antonia  Service  Area  (SASA).  Ft  Palk  ftloo  receiver  some  of  their  specialty  consultations  from  BAMC 
providers  at  Bayne- Jones,  to  therefore  the  actual  number  of  specialty  visit*  i*  higher. 


Dycsi  refers  over  26  beneficiaries  a  rocmh  to  the  San  Antonio  Service  Area  (5ASA)  and  over  20  a 
mcmh  to  Sheppard  APB 

Ttitmmiow:  Art  MDIS  ititradiology  small  spoke  tysuim  ha*  Already  been  Funded  and  purchased  far 

Vance  Clinic  atvd  a  large  cpolce  for  Dyers  Hospital.  Ybc  following  Si  fV*  are  scheduled  to  be  installed  with 
*I*,kc  systems  in  FY  97:  GoodfcJlew,  Laughlirv  and  Aitus  AFB.  Therefore  the  Pilcit  Phase  will  include  t  small 
d&UWIIIlratiOfi  of  MDIS  utilizing  the  referral  capabil  ities  of  WHMC  and  BAMC.  17i e  tclcradlology  xysieres  will 
integrate  into  die  same  telecommunications  infrastructure  used  by  the  (elecoosnUmg  systems.  Tltis  integration 
will  capitalize  on  eccnoraies-of-scaie  and  sharing  of  unused  capabiUiy .  thereby  increasing  the  potential  of  these 
telemedicine  systems  cost- effect! vencss  by  reducing  duplication  of  communiceiions  infrastructures. 

Tclenathokxrvt  Armed  Forces  Institute  of  Pathology  (AFIP)  has  developed  a  icicpathology  system 
utilizing  Roche  Imaging  Systems  digoal  cqaiptrwn t  and  Olympus  microscope*  and  camera*.  Thas*  systems  will 
facihute  Lh«  review  by  pathologist*  -jL  WHMC,  BAMC,  and  AJFiP  for  more  difficult  ca*ci.  The  MTFj  that  are 
appropriate  for  this  technology  arc  WHMC,  BAMC,  Coipue  Chriiti.  Ft  Hood.  Sheppard.  Ft  Sill,  and  Ft  Polk. 
Currently  the  Roche  system  utilize*  POTS  (Plain  Okl  Telephone  System)  and  at  a  liter  date  when  the  System  is 
upgraded  for  T1  network  utilization,  will  be  added  to  the  Tclcmcsdicine  Network. 

Based  upon  the  MTF  and  Specialty  Participation  Saiacrion  Criteria  (developed  by  the  Clinical  Task  Force)  th« 
ahova  MTFs  war*  selected  for  the  Pilot  Phase  of  the  Telemedicine  PrejccL  Furthermore,  baaed  upon  the 
reftcrtU  pecteroa  already  axis ting  between  the  referring  MTF*  and  the  two  Medical  Gamers  and  the  volume  uf 
such  referrals,  specialties  tentatively  selected  were  ENTfOphiholmology,  Orthopedics,  Dermatology, 
Cardiology,  Pathology,  and  Spans!  Pediatric*.  Additional  speciskics  were  targeted  based  upon  their  interest 
tr*d  the  existence  of  the  central  Telemedicine  Suite  for  utilization  by  all  interested  specialties.  This  allow*  us  (o 
test  several  different  specialties  at  the  two  Medical  Centex*  and  inc locks  the  Jo*m  Dermatology  Residency 
Training  Program  between  WHMC  and  BAMC. 

Sutm  taifigirtthig; 

Tht  trial  rntMioncd  cviicr  yielded  resounding  Support  for  the  CLl  VTC  products  in  collaboration  wtih 
A7<LT  Telemedicine  soluikm*.  System  configuration  was  ultimately  driven  by  lb*  functional  user*  (providers) 
at  each  MTF  in  (he  Pilot  Project.  A  combine! km  of  approaches  are  utilized  including  a  roli-abuuL  portable 
configuration  and  development  of  permanent  Telemedicine  suites  for  telecoosuldag.  The  number  and  specific 
requirements  will  be  driven  by  specialty  participation  and  oecds  of  referring  physician*  in  the  remote  MTF?. 

Systems  will  include  Interactive  quality  video  and  audio,  store  ami  forward  graphics  capability,  video 
£-Mjal,  oft- 1  me  medical  tteotd  document  Riiofi  and  data  exchange,  document  camera*  (consultative  x-ray  quality 
images),  patient  cameras,  and  other  medical  peripherals  such  a*;  gNT  vjdeoscopc  packages,  digital 
stethoscopes,  ophthalmoscopes.  high  resolution  monitors,  fundus  camera,  and  slit  lamp  systems. 

£fmgre  Facility  (Pa  dm  /Yodel,  The  Patient  Node  consists  of  a  full  Tdccarauiiarioct 

Workstation  which  include*:  CLl  Radiance  VTC  Systems  with  Dual  27*  Monitors;  Pentium  based  under-the- 
counter  PC  with  an  over-sired  monitor,  EJ  Touch- Screen  technology;  MD/TV  Up™* wyif  software  for  the 
creation  of  in  electronic  medical  folder  for  i^rt~and-fc?fw^  consult*.  and  three  cameras -"* 

SajpSeEip  mem  eamenuungle-chip  document  camera,  and  a  scope  camera  which  interface*  wtih  the  nwdk*l 
peripherals,  The  PC  Workstation  includes  a  Full-Motion  Capture  Card,  leaser  Printer  and  Text  Scanner. 

MtJicul  Cm/ar  System  (Cm luttea  N&kk  The  Con?ailumt  Node  consuls  of  the  same  equipment,  but 
without  the  scope  camera  and  associated  medical  peripherals.  The  consultant  node  it  capable  of  selecting  all  three 
patient  node  cairarxs  and  mvupulatijtg  the  roam  rad  patient  cameras.  It  Is  also  able  to  capture  or  import  imxge* 
and  anoocme  them  by  markup,  keyboard  taxi  or  audio  recording.  The  resulting  image  and  annotation  is  stored  os 
part  of  the  particular  consultation  within  (ha  softwares  database. 

Each  Medical  Center  will  have  a  central  Tdcmodkinc  Suite  including  the  following  equipment:  Pentium 
PC  (listed  above),  CLl  Radiance  Model  8875  Dual  ZT  Monitor  Vkloo  System.  RS449  User  Data  Port  Supertum 
Document  Camera,  VHS  VOL  Tl  RS449  Interface  with  CTX  and  CTX  Plus. 


The  tyctemt  in  the  leven  specialty  ci  lutes  will  provide  iturc  end  forward,  non- interactive  cjpabihty,  is 
wdl  oa  Dwktop  (ImmTwtlve)  VTC  capability.  The  PCj  will  be  networked  over  a  fiber  optic  LAN  sharing  three 

g-.nlrelUad  CT  T  mnPf^  ^  - - - 


The  project  utilises  dedicated  T1  terrenria’  lines  and  a  MCU  that  at  lows  aU  seven  sites  to  conduct  projecT 
user  and  other  mulusiw  meetings.  ■=• 


LINDA  EATON 

Captain ,  USAF,  MSC 

Director,  Telemedicine 

TRICARE  Southwest,  DoD  Region  VI 

(210)67802(7 

eaionl  $  triwpgtuc.af.mil 


APPENDIX  O 


DACH  TELEMEDICINE  CONCEPTS  AND  REQUIREMENTS 


DARN  ALL  ARMY  COMMUNITY  HOSPITAL 
DEPARTMENT  OK  EMERGENCY  MEDICINE 
TELEMEDICINE  CONCEPTS  AND  REQUIREMENTS 


MCXI-DEM 


24  November  1907 


I  he  purpose  of  this  statement  is  in  response  to  the  tasking  by  the  C.  IMD  and  DCCS  of  Darnall  Army  Community  Hospital 
tor  the  identilication  of  the  concepts  and  requirements  for  Telemedicine  in  the  Department  of  Emergency  Medicine  at 
Darnall  Army  Community  Hospital. 


I  he  Darnall  Army  Community  I  lospita!  Telemedicine  Policy  guidelines  were  authored  by  Dr.  Eric  Kobylarz  (Dept  of 
Neurology)  and  myself  at  the  request  of  the  previous  DACH  Hospital  commander  Col.  James  W.  Kirkpatrick. 

I  le  authored  a  command  policy  document  from  these  guidelines,  which  was  Instituted  on  24  January  1997, 

A  summary  follows: 


Definition:  Telemedicine  involves  the  use  of  telecommunications  technologies  as  a  medium  for  the  provision  of 

medical  information  and  services  to  consumers  at  sites  that  are  remote  from  the  provider 

Objective  To  effectively  and  expeditiously  aid  in  the  evaluation,  diagnosis,  and  treatment  of  patients  at  DACH  and 

other  health  care  facilities.  The  intent  is  to  provide  universal  access  to  high-quality  care  facilities,  at  an 
affordable  cost  through  the  use  of  currently  available  technology. 

flic  DACH  telemedicine  system  will  be  used  for  the  following  purposes: 

1.  To  screen  patients  evaluated  at  affiliated  satellite  clinics  to  facilitate  the  triage  process. 

2.  To  consult  physicians  and  health  care  providers  at  other  facilities,  military  and  civilian,  for  services 
and  subspecialties  not  available  at  DACH. 

3  To  provide  remote  diagnosis  and  consultation  services  for  patients  at  sites  remote  from  DACH 

The  DACI 1  Telemedicine  Standard  Operating  Procedures  include  the  following: 

1  Telemedicine  is  not  to  replace  existing  DACH  health  services,  but  will  supplement  and 
compliment  what  is  otherwise  available. 

2  The  DACH  Telemedicine  Service  will  train  personnel  to  effectively  operate  the  telemedicine 
apparatus  and  provide  them  with  assistance  should  this  be  needed  during  the  use  of  the  system 

3.  Personnel  requesting  its  use  by  notifying  the  service  to  which  the  unit  belongs  will  reserve  the 
telemedicine  apparatus.  The  service  will  oversee  the  schedule. 

4  The  quality  of  health  care  delivered  at  DACH  should  never  be  compromised  through  the  use  of 
Telemedicine.  All  DACH  health  care  providers  should  be  cognizant  of  the  limitations  of  this 
technology  and  realize  when  its  use  is  contraindicated  for  patient  evaluation  and  care. 

5  A  non-lieensed  health  care  provider  can  operated  the  telemedicine  apparatus  under  the  direction  of  a 
licensed  health  care  provider. 

6  A  licensed  health  care  provider  is  required  to  fill  out  the  DA  Form  5 1 3,  which  will  be  faxed  to  the 
location  of  the  patient  and  immediately  placed  into  the  patient’s  medical  record 

7  Medication  prescriptions  for  non-Schedule  B  drugs  will  be  faxed  to  the  location  of  the  patient  and 
filled  at  the  local  pharmacy. 

8.  When  invasive  procedures  are  to  be  performed  during  the  telemedicine  consultation,  a  second 
telemedicine  link  will  be  established  at  the  closest  possible  location  in  order  to  provide  a  back-up 
apparatus. 

9  The  referring  service  where  the  patient  is  located  will  be  provided  credit  for  the  workload  for  the 
Telemedicine  consultation. 

1 0.  The  DACH  telemedicine  system  must  be  updated  to  keep  abreast  of  the  current  telecommunications 
and  medical  technology  in  order  to  deliver  the  best  possible  health  care  to  the  patient, 

I  I  DACH  health  care  providers  and  patients  will  be  asked  to  provide  constructive  feedback  regarding 
their  opinion  of  the  telemedicine  system  and  suggestions  for  its  modification  in  order  to  continually 
improve  the  quality  ol  the  system  itself  and  its  implementation. 


As  a  |KCVI0US  i’KOFIS  assignment  with  the  C/4FSB  of4li>  Advanced  Wartiuhier  Exorcise  it  the  M.,  it.  ~ 

I  on  Irwin,  Calif  ,  my  responsibility  as  D ACINI- mcryeiicy  Department  (CD)  Telemedicine  Coordinator' lc  ™""lg  C‘:i,,cr- 
tclemcdicmc  initiative  during  Held  training  exercises  The  DACIl  F.D  was  confmured  with  a  l»ictol  V  I  ,  |l 

j  T'7  r  ms  m,lM  ** pcr  day  f" ,wo  iv“ks  vre.^'^rs^’  zzxzrsr* 

kLhnw..l  evaluations  were  performed  in  order  to  improve  telemedicine  support.  From  my  experience  witluhis ’initiative 
and  telemedicine  utilization  at  DACII  several  requirements  have  been  brought  forward 

I  Fqmpment  constraints  prevent  quality  VTC  connections  between  Held  units  and  the  DACH-ED 

a  Modem  speed  for  dig, t, zed  and  microwave  information  should  be  no  slower  Ilian  twin-56kbs  Note  that 

erefwe  It^r  Ttd  ?  ^  ^  '*  V  aS  8°°d  M  ,hc  s,«nal  ^nmai  from  the  Held  station  and 

thcrefo.c  the  held  site  modems,  cameras  and  satellite  equipment  should  be  of  high  qualify  This  will 

Sfi'vfc"sS,!°  '  S'Bn:"S  rK'i',ed  by  ED  “  ,K,,Cd 

b  faster  T I  or  Telcos  switching  and  wiring  installed  in  the  hospital  communications  equipment  is 

nddpalicnr  ^  *  'C  bCSl  V'SUal  and  S0U,Ul  qt'aii,y  Thi*  is  cssc,uial  for  clcar  visual  evaluation  of  the 

Monitor  size  sltouid  be  no  smaller  than  20  inch  if  mounted  on  a  cart. 

Rotational  camera  that  is  already  mounted  on  many  VTC  units 

Digitization  equipment  and  software  arc  necessary  to  download  x-rays  and  documentation 
lie  newest  laptops  now  on  the  market  provide  the  complete  basic  unit  with  a  screen-mounted  camera 
(hg.t.zauon  software  and  high-speed  data  modems  and  large  capacity  hard  drives.  These  units  arc  both’ 
cost  effective  and  extremely  space  efficient. 

*  mo<^e  w  which  the  Emergency  department  will  perform  its  duly 

a  Telemedicine  has  been  in  use  at  many  civilian  lID  s  for  the  past  10  years.  They  provide  connectivity 
with  outlying  satellite  communities  that  do  not  have  expert  medical  care.  The  DACH-ED  is  fuilv 
staffed  by  American  Board  of  Emergency  Medicine  Certified  physicians  who  are  practiced  m  the  latest 
clinical  application  of  emergency  care.  Field  units  utilizing  telemedicine  would  greatly  benefit  from 
their  expertise  and  support  it  the  DACH  DEM  were  provided  with  state  of  the  art  equipment  In  my 
opinion,  the  DEM  should  be  utilized  as  the  consultant  service  and  provide  medical  support  for  field 
units  or  satellite  climes  m  the  Fort  Hood  area  and  those  military  installations  with  ED’s  or  clinics  not 
stafled  by  an  emergency  physician. 

b  However,  in  an  attempt  to  maintain  rapid  patient  care  support  and  disposition,  I  cannot  support  the 
mode  of  connectivity  from  the  ED  to  in-house  or  BAMC  consult  services.  The  logistical  complication 
of  supporting  the  ED  consult  requirements  on  a  24!ir  basis  would  make  its  use  impractical  The 
consulted  services  would  need  24hr  access  to  a  VTC  in-house.  This  may  be  technically  solved  but 
services  would  have  to  slay  on-call  in-house  to  answer  the  VTC  on  an  emergency  basis  as  needed  to 
support  i he  DACH-ED  with  annual  visits  of  65,000  patients  per  year. 
l  ^mce  telemedicine  is  becoming  a  part  of  many  emergency  departments  nation  wide,  training  of  DACH 
stafTand  resident  medical  personnel  in  the  DEM  would  also  provide  a  higher  level  of  education  and 
experience  for  employment  in  the  civilian  sector 

3  Quality  of  patient  care  issues 

n  As  noted  on  SOP  articles  I  and  4  above,  by  definition,  telemedicine  does  not  have  a  use  m  the 
emergency  patient  whose  medical  support  must  come  from  the  department  stafTand  residents  on  a 
timely  basis.  Its  utilization,  as  noted  by  AWE-NTC  patients  is  predominately  for  urgent-care  patients 
who  do  not  require  consultations  for  admission  to  the  operating  room  or  ward  Even  to  this  end, 
specific  diagnosis  and  therapies  will  eventually  rise  out  of  continuous  consultation  as  in  dermatologic 
or  radiologic  diagnoses. 

b  DEM  quality  improvement  issues  require  continuous  evaluation  of  patient  care  and  benefits, 
derived  Irom  use  of  telemedicine,  as  well  as  user  feedback  and  continuing  education 


L  Albert  Villai in,  Jr 
CP  T,  MC 
Telemedicine  Coordinator 
DACH-DEM 
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DACH  TELEMEDICINE  MEMORANDUMS 


MCXI-OBG 


7  November  1997 


MEMORANDUM  FOR  MEDDAC,  DCCS 
SUBJECT:  Telemedicine 


The  DACH  Department  of  OB/Gyn  has  been  using  telemedicine  since  the 
combined  BAMC-WHMC-DACH  residency  program  was  started  in  April  1996 
Currently,  we  utilize  the  system  on  Thursday  mornings  between  0800  -  1000  for 
the  purpose  of  GME/CME  conferences.  We  do  not  use  telemedicine  for  any 
other  purposes  at  this  time. 


MAJOR,  Medical  Corps 
Chief,  Dept  OB/Gyn 


Author:  COL  Daniel  Knodel  at  MEDDAC5  FTHOOD 

Date:  11/9/97  11:42  am 

Priority:  Normal 

TO:  COL  Janes  Gilman  at  MEDDAC2_FTHOOD,  MAJ  Erik  Kobylarz  at  MEDDAC4  FTHOOl 
LTC  Leo  Conger  at  MEDDAC2  fthood,  sfc  Axel  Torres  imooi 

Subject:  Response  to  Tasker  NO.  7309-0002  Telemedicine 

COL  Gilman: 


The  Department  of  Medicine  requests  the  following  telemedicine 
capabilities: 


1)  Dial  anywhere  capability  on  4  West-utilized  by  receivina 
conferences  from  Brooke  Army  Medical  Center. 


,2\  Dial  anywhere  telemedicine  capability  at  the  Adult  Chronic  Cart 
w  This  is. imperative  for  the  medical  resident  training  program 

scheduled  to  begin  6/98,  It  will  be  utilized  primarily  for 
broadcasting  noon  conferences  and  other  case  presentations/reviews  a« 
well  as  educational  programs.  ' 


3)  Dial  anywhere  telemedicine  capability  in  the  Dermatology 
Clinic.  This  is  utilized  for  resident  teaching,  as  well  as  case 
consultation. 

It  is  presumed,  that  with  dial  anywhere  capability,  expanded  functions 
for  telemedicine  will  develop  over  time. 

POC  for  the  Department  of  Medicine  for  Telemedicine  is  MAJ  Erik 
Kobylarz  288-8080.  POC  for  Internal  Medicine  Clinic  and  the  AC 3  is 
SGT  Axel  Torres  288-8074.  POC  for  Dermatology  is  LTC  Leo  Conqer 
288-8080. 


Otolaryngology 

Service 


Memo 

To;  DCCS  through  DOS,  Linda  Jordan 
From:  H.  Close,  MD 
Date:  11/16/97 
Re:  Telemedicine 


-  1  The  Otolaryngology  service  requests  support  for  use  of  Telemedicine  communication  on  Tuesday 
mornings  from  0800-1 000. 

2.  Otolaryngology  combined  Telemedicine  conferences  occur  in  San  Antonio  between  BAMC, 
Wilford  Hall,  and  the  UT-San  Antonio  medical  school. 

3.  Residents  from  the  military  residency  rotate  on  our  service  about  seven  months  out  of  the  year. 
Teaching  staffs  in  San  Antonio  and  Damall  agree  that  the  residents  should  be  able  to  participate  in 
the  Grand  rounds  that  these  Telemedicine  conferences  include.  Additionally,  our  own 
communication  and  presentations  during  these  conferences  will  reinforce  that  the  quality  of  patient 
care  as  well  as  the  diversity  of  patient  pathology  at  Damall  is  an  essential  part  of  the 
Otolaryngology  resident’s  experience.  Finally,  this  forum  will  facilitate  sharing  of  specific  patient’s 
follow  up  between  the  medical  centers  and  Damall. 

4.  Previous  attempts  to  coordinate  this  support  have  been  unsuccessful. 

5.  POC  for  the  above  memo  is  the  undersigned  at  288-8490. 


Heidi  L.  Close,  MD 
MAJ,  MC 

C,  Otolaryngology  Service 


MCX-DOS-NEU 


2 1  Nov  97 


MEMORANDUM  THROUGH  CHIEF,  DEPARTMENT  OF  SURGERY'^ 

i  or  deputy  commander  for  clinical  Services 


SUBJEC 1 :  Use  of  telemedicine  facilities  for  consultation 


1 .  II  would  be  highly  desirable  for  me  to  have  access  to  telemedicine  facilities  during  normal  duty  hours. 
I  Ins  would  allow  me  as  a  solo  practitioner  to  consult  with  the  orthopedic  spine  surgery  service  and 
pediatric  neurosurgery  service  at  Wilford  Hall  Air  Force  Medical  Center,  the  neurosurgery  service  at 
Brooke  Army  Medical  Center  and  the  neurosurgery  service  at  Walter  Reed  Army  Medicai  Center  I 
anticipate  that  this  need  will  arise  only  once  or  twice  a  month. 

2.  POC  is  the  undersigned  at  286-7  I  1 8. 


IXil'AKTMilNT  0!;  I  I  II:  ARMY 
US  ARMY  MODICAL  DI:PARTMtiNT  ACTIVI I  Y 
DARNAI.L  ARMY  COMMUNITY  I IOSPITAL 
IT  HOOD,  IX  76544 


15  November  1797 


MEMORANDUM  I  OK.  COL  GILMAN,  DCCS 

THRU:  LTC  RICHARDS,  C,  DAC  T 

SUBJECT:  Response  to  Tasker  II  7309-0002  (Telemedicine) 


1 .  Recommend  concept  of  tclemedical  operations  within  the  Department  of  Ambulatory  Care  be  divided 
mlo  three  phases  for  gradual  introduction.  Initially,  connectivity  from  (he  Bennett  and  Monroe  Clinics 
should  be  established  to  provide  subspecialty  consultation  with  DACH.  Following  this,  dataiink  from 
the  FCC-DA  lo  BAMC  should  be  established  with  parallel  lines  running  from  the  already  integrated 
TMCs.  As  a  final  step,  integration  of  the  outlying  FCCs  in  Killeen  and  Copperas  Cove  should  be  set 
up.  There  is  currently  no  need  to  integrate  the  BAS  or  other  TMCs  but  we  should  be  prepared  for  future 
implementation  in  the  new  COSCOM  consolidated  clinic  when  it  is  built.  A  stepwise  approach  is 
sensible  in  that  it  allows  us  to  work  out  bugs  within  the  system,  slowly  integrate  the  system  into  (he 
workplace  and  provide  training  to  the  user  while  giving  the  user  the  opportunity  to  provide  feedback  on 
changes  and  improvements.  Obviously,  these  steps  can  be  combined  into  one  at  the  risk  of  creating  a 
mediocre  and  untested  system  (one  that  providers  will  not  support  or  use). 

2.  The  key  to  a  successful  integration  of  this  type  of  hardware  is  three-fold:  education,  location  and 
reliability.  Clearly,  an  educated  provider  that  realizes  the  potential  benefits  to  both  patient  and  provider 
is  one  who  will  be  motivated  to  utilize  this  relatively  new  technology.  Thus,  time  has  to  be  made 
available  to  train  providers  in  the  use  of  this  equipment  so  that  it  is  not  seen  as  an  additional  task  or 
burden  (as  CHCS  was  initially  perceived  in  the  late  80’s).  As  an  added  benefit,  our  military  providers 
get  trained  on  the  use  of  equipment  that  may  be  available  the  next  time  they  deploy.  A  room  that  is 
large  enough  to  house  the  telemedicine  equipment,  the  patient  and  at  least  one  provider  will  need  lo  be 
made  available  at  each  clinic  to  allow  easy  access  to  the  system.  This  will  encourage  the  use  of 
telemedicine  and  lessen  frustration  with  time  constraints  and  patient  compliance  (i.e.  patient  may  not 
show  for  follow-up  telemedicine  consultation).  Finally,  the  system  has  to  be  up  and  running  ANY  time 
the  clinic  is  open.  Providers  will  be  unlikely  to  take  time  out  in  order  to  determine  functional  status 
prior  to  using  this  system;  they  will  revert  to  using  other  forms  of  consultation  if  there  is  a  perception 
that  this  new  “gadget”  is  frequently  “down”  As  an  aside,  CHCS  system  should  be  up  and  running  at  all 
sites  with  data  retrieval/transmission  possible  all  the  way  to  BAMC. 

3.  The  following  addresses  (he  question  of  hardware  requirements.  As  wc  represent  a  wide  spectrum  of 
providers  (FP,  GP,  PA,  FNP,  Peds,  PNP)  we  must  have  a  multitude  of  modules  available.  Modules  for 
transferring  both  realtime  (or  near  realtime  10-20  frames  per  second)  and  static  data  (xrav,  ECG)  are 
required.  The  WRAMC  article  (Tab  A)  and  the  Telemedicine  in  Bosnia  article  (Tab  B)  further 
delineate  technical  specifications  of  the  types  of  equipment,  but  the  following  is  a  list  of  likely 
minimum  hardware  needs: 

a.  Camera  attachments  for  otoscope/opthalmoscope  heads  (additional  light 

sources  needed  for  optimal  resolution?) 

b.  Interface  between  iiCG  and  computer  or  600  ( DPI  scanner 

c.  Microphone  (consider  stethoscopic  microphone) 

d.  Xray  view  transmission  (scanner  better  than  video?) 


4.  Our  IlCPs  ns  well  ns  III  Corps  providers  should  utilize  as  this  equipment  lor  on  the  spot  consultations 
with  specialists  at  DACII  initially  and  eventually  with  BAMC.  This  should  replace  the  use  of 
telephonic  consultation  and  may  require,  at  least,  receiving  terminals  in  all  clinics  at  this  hospital  in 
order  to  be  billy  cflcctivc.  Collateral  benefit  to  the  use  of  this  technology  in  garrison  by  all  ft.  I  bod 
1  ICPs  is  that  ii  will  familiarize  and  build  confidence  in  a  system  they  will  likely  encounter  and  use  in  a 
deployed  setting.  Another  sidebar  benefit  to  this  technology  will  be  the  ability  to  videoconference 
CME  lectures  throughout  all  of  our  sites,  decreasing  driving  time  and  time  away  from  clinical  duties. 
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REL-Technology  Profile 
TELEMEDICINE 


Telemedicine  Initiative 

User  Survey 

To  be  completed  by  initiative  site  and  returned  before  briefing  and  site  visit 


DARNALL  ARMY  COMMUNITY  HOSPITAL  (DACH) 

Title  of  initiative:  BAMC/DACH  Hospital  without  walls 

Point  of  contact: 

Name:  Everett  E.  Pitt  Jr. 

Title:  Chief,  Telecommunications 

Address:  Darnall  Army  Community  Hospital,  Ft.  Hood 

Telephone:  (254)  288-8863 

FAX:  (254)287-1943 

Email:  ed_pitt@smtplink.hood.amedd.army.mil 

URL:  N/A 

Initiative  proponent  or  sponsor:  MEDCOM 


Description  of  initiative: 

describe  the  overall  objective,  current  practice  or  approach  limitations  of  current 
practice  that  will  be  addressed  by  the  new  technology,  and  method  for  using  the  new 
technology 

Provide  link  between  BAMC/DACH  for  consults  physician/patients  at  remote 
locations  and  realize  care  by  keeping  soldiers  at  home  station  rather  than 
sending  to  BAMC. 

Application  scenario: 

provide  one  or  more  examples  of  use,  focusing  on  the  clinical  environment,  when 
appropriate 

-  Neonatal  Intensive  Care 

-  Dermatology 

-  Internal  Medicine 

List  sites  at  which  the  technology  will  be  used: 

At  this  time,  Darnall  has  capability  to  utilize  20  locations  for  telemedicine/video 
conferencing  purposes.  With  the  install  of  the  DS3  MEDNET  network  and  the 
TELEOS  switch,  dial  up  to  anywhere  with  telemedicine  equipment  could  be 
achievable.  Presently  this  network  is  not  being  utilized  to  the  full  extent  duet  o 
ongoing  equipment  problems.  However,  thru  the  use  of  point-to-point  technology 
(T1),  we  do  utilize  telemdicine  in  our  NICU  and  dermatology  units. 
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REL-Technology  Profile 
TELEMEDICINE 


Once  the  problems  we  are  experiencing  with  our  NEC  equipment  has  been 
resolved,  we  will  have  dial  anywhere  capability  from  any  of  the  following  areas: 

NeoNatal  Intensive  Care  Units 

Dermatology 

Emergency  Room 

Internal  Medicine  Clinic 

Pediatric  Clinic 

OB/GYN  Clinic 

Opthalmology  Clinic 

AC-3  Trimmier  Clinic  (remote  clinic  located  in  downtown  Kileen) 

Use  of  our  PICTEL  equipment  allows  the  use  of  5  locations  which  can  use  the 
MEDNET  network  but  this  is  only  used  at  this  time  for  resident  training  and 
videoconferencing  between  different  locations  in  the  US 

Commanders  Office 

Hospital  Auditorium 

Command  Conference  Room 

Logistics  Conference  Room 

DCCS  Conference  Room 

CSD  Conference  Room 

Region  VI  Lead  Agent  (5th  Floor  location) 

Following  locations  are  presently  wired  but  not  equipped  at  the  TELEOS.  These 
locations  are  being  planned  for  the  future 

Pathology 

Psychiatry 

Radiology 

Surgery 

Timeline  of  initiative: 

date  work  started,  date  of  first  clinical  use,  date  of  full  implementation,  anticipated 
length  of  project 

April  96  (ongoing) 

Accomplishments  to  date: 

Major  accomplishments  derived  from  cost  savings,  actual  savings  of  a  newborn 
utilizing  echo  via  telecommunications  utilizing  MEDNET  network 
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System  components: 

list  hardware,  software,  networking,  telecommunications  requirements 

1 0  each  NEC  Telemedicine  Carts  (Roll-around) 

2  each  PicTel  Units 
-  1  each  VTEL  Unit 
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Telemedicine  Initiative 

Technology  Profile 

To  be  completed  by  the  REL  Team 

MISSION 

Unable  to  provide  actual  data*/Estimates  only 
1 .  Category  of  Technology  %  time  used  for  each 

Direct  clinical  care:  only  Derm  and  Nico  currently 

□  diagnostic  1 00% 

□  therapeutic  _ 

□  preventive  _ 


Non-clinical  use: 

□  administrative  10% 

□  education/training  30% 

□  health  promotion  30% 

□  logistical  15% 

□  marketing/improve  morale  15% 


2.  Application  Environment 

Combat  casualty  care 

□  reduce  battlespace  deaths(KIA)  0% 

□  reduce  evacuations  0% 

□  reduce  combat  stress  0% 

Keep  AD  forces  on  job 

□  disease  management  (DNBI)  (deployed)  0% 

□  disease  management  (DNBI)  (sustaining  base)  50% 

(Dermatology  Only) 

□  Preventive  (deployed)  0% 

□  Preventive  (sustaining  base)  25% 

□  Humanitarian  assistance  (non-DOD  beneficiary)  0% 

□  Sustaining  base  (beneficiary  care)  0% 

□  Reduce  MHSS  skill  mix  and  staffing  25% 

□  Reduce  health  service  requirements  of 

TRICARE  support  contractors  0% 

□  Keep  beneficiaries  at  work  or  home  0% 


*  Actual  usage  data  not  collected  due  to  1)  system  not  operational  or  2)  usage 
not  documented  -  Estimates  provided  by  DACH  personnel 
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3.  End  User 

□  Individual 

□  Combat  arms 

□  Combat  service  support 

□  Unit  (Echelon  1-2) 

□  Unit  (Echelon  3-4) 

□  Sustaining  base  (Echelon  5,  CONUS) 

4.  Role  of  AMEDD  in  this  initiative 

□  Researcher 

determines  fundamental  knowledge  related  to  the  scientific  or  engineering  field  being  investigated 

□  Developer 

solves  technical  and  engineering  problems  related  to  the  production  of  the  finished  product 

□  Systems  Integrator 

combines  products  from  multiple  sources  intoa  unique  product,  may  add  proprietary  hardware  or 
software  to  system 

□  Evaluator 

conducts  or  participates  in  clinical  or  technical  trials,  including  usability  testing 

□  Advisor 

provides  clinical,  military,  or  technical  expertise  to  developers 

□  None 

5.  Initiative  Driver 

□  Investigator-initiated  (investigator  academic  or  clinical  interests) 

□  Centrally  directed  (usamrmc,  dod-ha,  amedd  c&s,  etc.) 

6.  How  is  access  to  the  initiative  determined? 

What  patients  and  providers  participate?  How  are  they  selected? 

7.  Customer  base 

number  of  users 
number  of  units/devices 
number  of  uses  per  time  unit 
number  of  units  in  use  now 
total  number  of  units  needed 

8.  Market  penetration 

Uses  of  the  technology/total  incidence  or  number  of  uses 

one  year  ago 
today 

one  year  from  now  (estimated) 


?? 

1 0  NEQ~2~PicTel,  2  VTEL 
?? 

2PicTel,  2  VTEL 
0 


0% 

0% 

0% 

0% 

100% 
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MATURITY 

9.  Technology  Sources 

list  all  that  apply 

Non-developmental  item 

□  commercial  off-the-shelf  (COTS) 

□  government  of-the-shelf  (GOTS) 

Developmental 

□  enhanced  (customized)  GOTS/COTS  PicTEL,  VTEL 

□  custom  (“one-off,”  finished  product)  NEC  Units 

□  prototype  (as  a  phase  of  development) 

10.  Integration  with  existing  IM/IS  infrastructure 

□  Yes 

□  full  functionality  Part  of  TELEOS  System 

□  demonstration  mode  only 

□  No 

11.  Anticipated  time  to  mainstream  acceptance  and  use 

□  Today  (1997-2000) 

□  Transition  (2000-2007) 

□  Force  XXI  (2007-2017) 

□  Army  After  Next  (2017-2025) 

□  Army  of  the  future  (beyond  2025) 

12.  Barriers  to  entry 

□  development  cost 

□  unit  cost 

□  complexity 

□  physician/provider  resistance 

□  patient  resistance 

□  immature  technology 

□  competing  product  or  practice 

13.  FDA  regulatory  status 

□  None 

□  Under  review 

□  501k 

□  PMA 

□  Approved 
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PERFORMANCE 

14.  Describe  the  system  components 

model,  peripherals,  software  version,  weight/cube,  power  requirements,  MILSPEC, 
etc. 

Hardware 

Software:  Custom  from  Andreas  Tech  -  NEC 

Networking 

Telecommunications 

1 5.  What  data  fields  are:  Point  to  Point 

acquired: 

transmitted: 

archived: 

16.  How  is  data  transmitted?  Through  Med  Net 

1 7.  What  are  the  bandwidth  requirements?  Variable  56KBs  to  T 1 

18.  What  data  standards  are  currently  used? 

(e.g.,  HL7,  DICOM,  TCP/IP,  H32x) 

19.  What  is  the  system  load?  Unknown 

(frequency  of  use,  time  per  use) 

20.  How  is  integration  with  existing  IM/IS  resources  achieved? 

Using  Internet  through  SYSCO  Router 

21.  Is  the  system  used  in  a  clinical  evaluation  process?  NO 

22.  Is  the  process  approved  by  a  duly  constituted  institutional  review 
board?  NO 
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REL-Technology  Profile 
TELEMEDICINE 


RELIABILITY 

23.  What  is  the  reliability  level? 

number  of  times  use  is  successful/number  of  times  use  attempted 

Point  to  Point  (reliable),  dial-anywhere  (not  reliable) 

95%  NEC  with  T1,  major  problems  with  Dial-anywhere  capability 

24.  What  are  the  service  requirements? 

routine: 

unscheduled:  Mostly  call  Andreas  Tech  for  trouble  shooting  service  as  needed 

25.  What  personnel  are  allocated  to 

system  administration: 
technical  service  support:  2  FTEs 

26.  In  what  environments  is  the  system  designed  to  operate? 

NEC  -  Clinical  Environments 

27.  In  what  field  environments  has  the  system  been  tested? 

At  Vendors,  in  hospital,  in  units,  DACH  and  BAMC 

28.  What  training  is  required  before  using  the  system? 

Clinicians  are  taught  to  turn  on  the  units  and  basic  troubleshooting.  IMO 
personnel  are  available  for  troubleshooting  if  needed. 
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APPENDIX  R 


BJACH  TELEMEDICINE  PROFILE 


2nd  DRAFT 


Telemedicine  Initiative 

User  Survey 

To  be  completed  by  initiative  site  and  returned  before  briefing  and  site  visit 

FORM  WAS  NOT  COMPLETED  PRIOR  TO  SITE  VISIT 
Title  of  initiative:  Bayne-Jones  Army  Community  Hospital 


Point  of  contact: 

Name:  1 LT  Tom  Baker 

Title:  Chief  Information  Officer  (CIO) 

Address:  Ft.  Polk,  Louisiana 

Telephone:  (318)  531-3819 

FAX:  (318)  531-3212 

Email:  1  LT_Thomas_Baker@polk.smtplink.amedd.army.mil 

URL: 

Initiative  proponent  or  sponsor:  Information  Not  Available 


Description  of  initiative: 

describe  the  overall  objective,  current  practice  or  approach,  limitations  of  current  practice  that  will  be 
addressed  by  the  new  technology,  and  method for  using  the  new  technology 

Information  Not  Available 

Application  scenario: 

provide  one  or  more  examples  of  use,  focusing  on  the  clinical  environment,  when  appropriate 

Information  Not  Available 

List  sites  at  which  the  technology  will  be  used: 

Information  Not  Available 

Timeline  of  initiative: 

date  work  started,  date  of  first  clinical  use,  date  of  full  implementation,  anticipated  length  of  project 

Information  Not  Available 

Accomplishments  to  date: 

Information  Not  Available 

System  components: 

list  hardware,  software,  networking,  telecommunications  requirements) 

Information  Not  Available 


Toigo  Associates,  Inc. 
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REL-Technology  Profile 
TELEMEDICINE 


Telemedicine  Initiative 

Technology  Profile 

To  be  completed  by  the  REL  Team 


MISSION 


1.  Category  of  Technology 

Direct  clinical  care: 

□  diagnostic 

□  therapeutic 

□  preventive 

Non-clinical  use: 

□  administrative 

□  education/training 

□  health  promotion 

□  logistical 

□  marketing/improve  morale 


%  time  used  for  each 


0% 

0% 

0% 


? 


? 


2.  Application  Environment 

Combat  casualty  care 

□  reduce  battlespace  deaths(KIA) 

□  reduce  evacuations 

□  reduce  combat  stress 

Keep  AD  forces  on  job 

□  disease  management  (DNBI)  (deployed) 

□  disease  management  (DNBI)  (sustaining  base) 

□  Preventive  (deployed) 

□  Preventive  (sustaining  base) 

□  Humanitarian  assistance  (non-DOD  beneficiary) 

□  Sustaining  base  (beneficiary  care) 

□  Reduce  MHSS  skill  mix  and  staffing 

□  Reduce  health  service  requirements  of 
TRICARE  support  contractors 

□  Keep  beneficiaries  at  work  or  home 
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REL-Technoiogy  Profile 
TELEMEDICINE 


3.  End  User 

□  Individual 

□  Combat  arms  _ 

□  Combat  service  support  _ 

□  Unit  (Echelon  1-2)  _ 

□  Unit  (Echelon  3-4)  _ 

□  Sustaining  base  (Echelon  5,  CONUS)  _ 

4.  Role  of  AMEDD  in  this  initiative 

□  Researcher 

determines  fundamental  knowledge  related  to  the  scientific  or  engineering  field  being  investigated 

□  Developer 

solves  technical  and  engineering  problems  related  to  the  production  of  the  finished  product 

□  Systems  Integrator 

combines  products  from  multiple  sources  into  a  unique  product,  may  add  proprietary  hardware  or 
software  to  system 

□  Evaluator 

conducts  or  participates  in  clinical  or  technical  trials,  including  usability  testing 

□  Advisor 

provides  clinical,  military,  or  technical  expertise  to  developers 

□  None 

5.  Initiative  Driver 

□  Investigator-initiated  (investigator  academic  or  clinical  interests) 

□  Centrally  directed  (usamrmc,  dod-ha,  amedd  c&s,  etc.) 

6.  How  is  access  to  the  initiative  determined? 

What  patients  and  providers  participate?  How  are  they  selected? 


7.  Customer  base 

number  of  users 
number  of  units/devices 
number  of  uses  per  time  unit 
number  of  units  in  use  now 
total  number  of  units  needed 

8.  Market  penetration 

Uses  of  the  technology/total  incidence  or  number  of  uses 

one  year  ago 
today 

one  year  from  now  (estimated) 
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REL-Technology  Profile 
TELEMEDICINE 

MATURITY 

9.  Technology  Sources 

list  all  that  apply 

Non-developmental  item 

□  commercial  off-the-shelf  (COTS) 

□  government  of-the-shelf  (GOTS) 

Developmental 

□  enhanced  (customized)  GOTS/COTS 

□  custom  (“one-off,”  finished  product) 

□  prototype  (as  a  phase  of  development) 

10.  Integration  with  existing  IM/IS  infrastructure 

□  Yes 

□  full  functionality 

□  demonstration  mode  only 

□  No 

11.  Anticipated  time  to  mainstream  acceptance  and  use 

□  Today  (1997-2000) 

□  Transition  (2000-2007) 

□  Force  XXI  (2007-2017) 

□  Army  After  Next  (2017-2025) 

□  Army  of  the  future  (beyond  2025) 

12.  Barriers  to  entry 

□  development  cost 

□  unit  cost 

□  complexity 

□  physician/provider  resistance 

□  patient  resistance 

□  immature  technology 

□  competing  product  or  practice 

13.  FDA  regulatory  status 

□  None 

□  Under  review 

□  501k 

□  PMA 

□  Approved 
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REL-Technology  Profile 
TELEMEDICINE 


PERFORMANCE 

14.  Describe  the  system  components 

model,  peripherals,  software  version,  weight/cube,  power  requirements,  MILSPEC, 
etc. 

Hardware  INFORMATION  NOT  AVAILABLE 

Software 

Networking 

Telecommunications 


15.  What  data  fields  are  INFORMATION  NOT  AVAILABLE 

acquired: 
transmitted: 
archived: 


16.  How  is  data  transmitted?  INFORMATION  NOT  AVAILABLE 

17.  What  are  the  bandwidth  requirements?  INFORMATION  NOT 
AVAILABLE 


18.  What  data  standards  are  currently  used? 

(e.g.,  HL7,  DICOM,  TCP/IP,  H32x) 

INFORMATION  NOT  AVAILABLE 

19.  What  is  the  system  load  ? 

(frequency  of  use,  time  per  use) 

INFORMATION  NOT  AVAILABLE 

20.  How  is  integration  with  existing  IM/IS  resources  achieved? 

INFORMATION  NOT  AVAILABLE 


21.1s  the  system  used  in  a  clinical  evaluation  process? 

INFORMATION  NOT  AVAILABLE 


22.1s  the  process  approved  by  a  duly  constituted  institutional  review 
board? 


NO 
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REL-Technology  Profile 
TELEMEDICINE 


RELIABILITY 

23.  What  is  the  reliability  level?  INFORMATION  NOT  AVAILABLE 

number  of  times  use  is  successful/number  of  times  use  attempted 

24.  What  are  the  service  requirements? 

routine:  INFORMATION  NOT  AVAILABLE 

unscheduled: 

25.  What  personnel  are  allocated  to 

system  administration: 
technical  service  support: 

INFORMATION  NOT  AVAILABLE 

26.  In  what  environments  is  the  system  designed  to  operate? 

INFORMATION  NOT  AVAILABLE 

27.  In  what  field  environments  has  the  system  been  tested? 

INFORMATION  NOT  AVAILABLE 

28.  What  training  is  required  before  using  the  system? 

INFORMATION  NOT  AVAILABLE 
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APPENDIX  S 


MEDNET  CONFIGURATION  MAP 


APPENDIX  T 


BAMC  BILLING  REPORT  FOR  25  FEB  98 


CALL  DURATION  REPORT  FOR  DEVICE  N10  (BAMC) 
Mon  2/16/98  0000  to  Monday  2/23/98  23:59:00 


>cord  # 


DATE 


Connect  Time 

Multi  Day? 


COUNT  SUM  DURATION  (#  MIN)  TOTAL  MINUTES 


43 

WH  N100  MDIS 

SUM  WH  N100  MDIS 

182.99 

5 

WH  N100  Other 

SUM  WH  N100  OTHER 

93764.65 

9 

Intra  BAMC 

Sum  Intra  BAMC  Min 

591341.55 

25 

NOD  N8 

SUM  NOD  N8 

2081.96 

3 

DACH  Nil 

SUM  DACH  Nil 

41788.52 

1 

POLKN12 

SUM  POLK  N12 

66666.2 

2 

SILLN14 

SUM  SILL  N14 

12236.88 

1 

MEDCOM  N19 

SUM  MEDCOM  N19 

84789.8 

3 

MAMC  N20 

SUM  MAMC  N20 

91940.36 

1 

BLISS  N51 

SUM  BLISS  N51 

25172.22 

2 

EAMC  N60 

SUM  EAMC  N60 

55732.86 

1 

TAMC  N70 

SUM  TAMC  N70 

91791.15 

4 

CARSON  N80 

SUM  CARSON  N80 

57318.7 

2 

REILEY  N82 

SUM  REILEY  N82 

58.94 

1 

LEVENWORTH  N83 

SUM  LEVENWORTH  N83  30715.07 

TOTAL  TIME  (min) 


1049112.96 


Call  Duration  Report  for  device  N10 
Non  Feb  23  1 1 sSQ-41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Port 

Port 

nm/dd/yy 

hh;mm:ss 

rrm/dd/yy 

hh:mm:ss 

N10C58P25 

N100C58P45 

02/16/98 

08:02:03 

02/16/98 

08:06:48 

N10C58P26 

N100C58P44 

02/16/98 

08:02:03 

02/16/98 

08:06:48 

W10C58P27 

N100C58P43 

02/16/98 

08:02:03 

02/16/98 

08:06:48 

N10C58P23 

N100C58P42 

02/16/98 

08:02:03 

02/16/98 

08:06:48 

Nl DC58P29 

N100C58P41 

02/16/98 

08:02:04 

02/16/98 

08:06:48 

N10C58P30 

N100C58P40 

02/16/98 

08:02:04 

02/16/98 

08:06:48 

N10C58P31 

N100C58P39 

02/16/98 

08:02:06 

02/16/98 

08:06:50 

N10C58P32 

N100C58P38 

02/16/98 

08:02:06 

02/16/98 

08:06:50 

N10C58P33 

N10DC58P37 

02/16/98 

08:02:06 

02/16/98 

08:06:50 

N10C53P37 

N100C58P33 

02/16/98 

08:02:08 

02/16/98 

08:06:51 

N 1 0C5SP38 

N100C58P32 

02/16/98 

08:02:08 

02/16/98 

08:06:51 

M10C58P34 

N100C58P36 

02/16/98 

08:02:06 

02/16/98 

08:06:51 

N10C58P39 

N100C58P31 

02/16/98 

08:02:09 

02/16/98 

08:06:51 

N10C58P35 

Nl 00C58P35 

02/16/98 

08:02:07 

02/16/98 

08:06:51 

N10C58P40 

N1C0C58P30 

02/16/98 

08:02:10 

02/16/98 

08:06:52 

N10C58P36 

N100C58P34 

02/16/98 

08:02:08 

02/16/98 

08:06:52 

N10C58P41 

N100C58P29 

02/16/98 

08:02:10 

02/16/98 

08:06:52 

C58P42 

N100C58P28 

02/16/98 

08:02:10 

02/16/98 

08:06:52 

JC58P43 

N100C58P27 

02/16/98 

08:02:11 

02/16/98 

08:06:53 

N10C58P44 

N100C58P26 

02/16/98 

08:02:11 

02/16/98 

08:06:53 

H10C58P45 

N100C58P25 

02/16/98 

08:02:11 

02/16/98 

08:06:53 

N10C58P46 

Ml 00C58P24 

02/16/98 

08:02:12 

02/16/98 

08:06:54 

N10C58P24 

N100C58P46 

02/16/98 

08:01:49 

02/16/98 

08:06:54 

N10C25P46 

N8C26P0 

02/17/98 

06:08:13 

02/17/98 

06:09:10 

N1GC25P45 

N8C26P1 

02/17/98 

06:08:30 

02/17/98 

06:09:11 

N10C58P25 

N100C58P45 

02/17/98 

09:58:47 

02/17/98 

10:04:32 

N10C58P26 

N100C58P44 

02/17/98 

09:58:47 

02/17/98 

10:04:32 

N10C58P27 

N100C58P43 

02/17/98 

09:58:47 

02/17/98 

10:04:32 

N10C58P28 

M100C58P42 

02/17/98 

09:58:47 

02/17/98 

10:04:32 

N10C58P29 

M100C58P41 

02/17/98 

09:58:47 

02/17/98 

10:04:32 

N10C58P3Q 

N100C58P40 

02/17/98 

09:58:48 

02/17/98 

10:04:32 

N10C58P31 

N100C58P39 

02/17/98 

09:58:50 

02/17/98 

10:04:32 

N10C58P32 

N100C58P38 

02/17/98 

09:58:49 

02/17/98 

10:04:32 

N10C58P33 

M100C58P37 

02/17/98 

09:58:51 

02/17/98 

10:04:33 

N10C5BP34 

N100C58P36 

02/17/98 

09:58:50 

02/17/98 

10:04:33 

N10C58P35 

N100C58P35 

02/17/98 

09:58:50 

02/17/98 

10:04:33 

N10C58P36 

N100C58P34 

02/17/98 

09:58:51 

02/17/98 

10:04:33 

N10C58P37 

N100C58P33 

02/17/98 

09:58:53 

02/17/98 

10:04:34 

N10C58P38 

M100C58P32 

02/17/98 

09:58:53 

02/17/98 

10:04:34 

N10C58P39 

N1Q0C58P31 

02/17/98 

09:58:53 

02/17/98 

10:04:34 

N10C58P40 

M100C58P30 

02/17/98 

09:58:53 

02/17/98 

10:04:34 

N10C56P41 

N100C58P29 

02/17/98 

09:58:54 

02/17/98 

10:04:34 

”^C58P42 

M100C58P28 

02/17/98 

09:58:53 

02/17/98 

10:04:34 

058P43 

N100C58P27 

02/17/98 

09:58:55 

02/17/98 

10:04:34 

N10C58P44 

N100C58P26 

02/17/98 

09; 58;56 

02/17/98 

10;04 ;35 

N10C58P45 

N100C58P25 

02/17/98 

09:58:56 

02/17/98 

10:04:35 

N10C58P46 

N100C58P24 

02/17/98 

09:58:56 

02/17/98 

10:04:35 

M10C58P24 

N100C58P46 

02/17/98 

09:58:33 

02/17/98 

10:04:35 

N10C58P25 

N100C58P45 

02/17/98 

12:12:15 

02/17/98 

12:14:26 

Duration 

ddd:hh:mm;ss 

000:00:04:45 
000:00:04:45 
000:00:04:45 
000:00:04:45 
000:00:04:44 
000:00:04:44 
000:00:04:44 
000:00:04:44 
000:00:04:44 
000:00:04:43 
000:00:04:43 
000:00:04:45 
000:00:04:42 
000:00:04:44 
000:00:04:42 
000:00:04:44 
000:00:04:42 
000:00:04:42 
000:00:04:42 
000:00:04:42 
000:00:04:42 
000:00:04:42 
000:00:05:05 
000:00:00:57 
000:00:00:41 
000:00:05:45 
000:00:05:45 
000:00:05:45 
000:00:05:45 
000:00:05:45 
000:00:05:44 
000:00:05:42 
000:00:05:43 
000:00:05:42 
000:00:05:43 
000:00:05:43 
000:00:05:42 
000:00:05:41 
000:00:05:41 
000:00:05:41 
000:00:05:41 
000:00:05:40 
000:00:05:41 
000:00:05:39 
000 ; 00 ; 05 ; 39 
000:00:05:39 
000:00:05:39 
000:00:06:02 
000:00:02:11 


Call  Duration  Report  for  device  N10 
Men  Feb  2J  11:50:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 
Origination  Termination  Connect  Time  Disconnect  Time  Duration 


Port 

Port 

nm/dd/yy  hh 

N10C58P26 

N100C58P44 

02/17/98 

12 

N10C58P27 

N100C58P43 

02/17/98 

12 

H10C58P28 

N100C58P42 

02/17/98 

12 

N10C58P29 

N100C58P41 

02/17/98 

12 

H10C58P30 

N100C58P40 

02/17/98 

12 

N10C58P31 

N100C58P39 

02/17/98 

12 

M10C58P32 

N10GC58P38 

02/17/98 

12 

M10C58P33 

N100C58P37 

02/17/98 

12 

N10C58P24 

N100C58P46 

02/17/98 

12 

N10C58P34 

N100C58P36 

02/17/98 

12 

M10C58P35 

N100C58P35 

02/17/98 

12 

N10C58P36 

H100C58P34 

02/17/98 

12 

N10C58P37 

N100C58P33 

02/17/98 

12 

N10C58P38 

N100C58P32 

02/17/98 

12 

N10C58P39 

N100C58P31 

02/17/98 

12 

N10C58P40 

N100C58P30 

02/17/98 

12 

N10C58P41 

N100C58P29 

02/17/98 

12 

1C58P42 

N100C58P28 

02/17/98 

12 

.0C58P43 

N100C58P27 

02/17/98 

12 

N10C58P44 

N100C58P26 

02/17/98 

12 

N10C53P45 

M10CC58P25 

02/17/98 

12 

M10C58P46 

N100C58P24 

02/17/98 

12 

M10C5SP2S 

N100C58P45 

02/17/98 

13 

N10C58P26 

N100C58P44 

02/17/98 

13 

N10C58P27 

*  W100C58P43 

02/17/98 

13 

K10C58P28 

N100C58P42 

02/17/98 

13 

H10C58P29 

N100C58P41 

02/17/98 

13 

N10C58P30 

N100C58P40 

02/17/98 

13 

M10C58P31 

N100C58P39 

02/17/98 

13 

N10C58P33 

N100C58P37 

02/17/98 

13 

N10C58P34 

H100C58P36 

02/17/98 

13 

N10C58P35 

N100C58P35 

02/17/98 

13 

N10C58P36 

N100C58P34 

02/17/98 

13 

W10C58P37 

N100C58P33 

02/17/98 

13 

K10C58P38 

N1Q0C58P32 

02/17/98 

13 

N10C58P39 

N100C58P31 

02/17/98 

13 

N10C58P40 

N100C58P30 

02/17/98 

13 

N1QC58P32 

N100C58P38 

02/17/98 

13 

M10C58P41 

N100C58P29 

02/17/98 

13 

N10C58P42 

N1Q0C58P28 

02/17/98 

13 

N10C58P43 

N100C58P27 

02/17/98 

13 

N10C58P44 

N100C58P26 

02/17/98 

13 

'0C58P45 

N100C58P25 

02/17/98 

13 

JC58P46 

N100C58P24 

02/17/98 

13 

K1QC58P24 

N100C58P46 

02/17/98 

13 

W10C58P25 

N100C58P45 

02/17/98 

13 

N10C58P26 

N100C58P44 

02/17/98 

13 

K10C58P27 

N100C58P43 

02/17/98 

13 

N10C58P28 

N10QC58P42 

02/17/98 

13 

:mm;ss  mm/dd/yy  hhifmnss  ddd:hh:mm:ss 

12:15  02/17/98  12:14:27  000:00:02:12 

12:16  02/17/98  12:14:27  000:00:02:11 

12:16  02/17/98  12:14:27  000:00:02:11 

12:16  02/17/98  12:14:27  000:00:02:11 

12:16  02/17/98  12:14:27  000:00:02:11 

12:17  02/17/98  12:14:27  000:00:02:10 

12:18  02/17/98  12:14:28  000:00:02:10 

12:18  02/17/98  12:14:28  000:00:02:10 

12:01  02/17/98  12:14:28  000:00:02:27 

12:19  02/17/98  12:14:28  000:00:02:09 

12:19  02/17/98  12:14:28  000:00:02:09 

12:19  02/17/98  12:14:26  000:00:02:09 

12:20  02/17/98  12:14:28  000:00:02:08 

12:21  02/17/98  12:14:28  000:00:02:07 

12:21  02/17/98  12:14:28  000:00:02:07 

12:21  02/17/98  12:14:28  000:00:02:07 

12:22  02/17/98  12:14:28  000:00:02:06 

12:22  02/17/98  12:14:28  000:00:02:06 

12:23  02/17/98  12:14:28  000:00:02:05 

12:23  02/17/98  12:14:28  000:00:02:05 

12:24  02/17/98  12:14:28  000:00:02:04 

12:24  02/17/98  12:14:28  000:00:02:04 

38:13  02/17/98  13:39:37  000:00:01:24 

38:14  02/17/98  13:39:38  000:00:01:24 

38:14  02/17/98  13:39:38  000:00:01:24 

;  38 : 1 4  02/17/98  13:39:38  000:00:01:24 

:38:14  02/17/98  13:39:38  000:00:01:24 

:38: 14  02/17/98  13:39:38  000:00:01:24 

:  38 : 1 6  02/17/98  13:39:38  000:00:01:22 

:38: 17  02/17/98  13:39:40  000:00:01:23 

:  38:17  02/17/98  13:39:40  000:00:01:23 

:38:18  02/17/98  13:39:40  000:00:01:22 

:38:18  02/17/98  13:39:40  000:00:01:22 

:38: 18  02/17/98  13:39:40  000:00:01:22 

:38:19  02/17/98  13:39:41  000:00:01:22 

:38: 19  02/17/98  13:39:41  000:00:01:22 

:38: 19  02/17/98  13:39:41  000:00:01:22 

;38: 16  02/17/98  13:39:42  000:00:01:26 

: 38 1 20  02/17/98  13:39:42  000:00:01:22 

:38:21  02/17/98  13:39:43  000:00:01:22 

:38:21  02/17/98  13:39:43  000:00:01 :22 

: 38:22  02/17/98  13:39:43  000:00:01:21 

:38:22  02/17/98  13:39:43  000:00:01:21 

:3fi:23  02/17/98  13:39:44  000:00:01:21 

; 38:00  02/17/98  13:39:44  000:00:01:44 

:40:31  02/17/98  13:41:57  000:00:01:26 

:40:31  02/17/98  13:41:57  000:00:01:26 

:40;31  02/17/98  13:41:57  000:00:01:26 

: 40:32  02/17/98  13:41:58  000:00:01:26 


Call  Duration  Report  for  device  N10 
Hon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Port 

Port 

mm/dd/yy 

hh:nrm:ss 

mm/dd/yy 

hh:mm:s$ 

N10C58P29 

N 1 00C58P4 1 

02/17/98 

13:40:32 

02/17/98 

13:41:58 

N10C58P30 

N100C58P40 

02/17/98 

13:40:32 

02/17/98 

13:41:58 

M10C58P31 

M100C58P39 

02/17/98 

13:40:34 

02/17/98 

13:41:58 

N10C58P24 

N100C58P46 

02/17/98 

13:40:17 

02/17/98 

13:41:59 

Ml 0C58P32 

Ml 0CC58P38 

02/17/98 

13:40:33 

02/17/98 

13:41:59 

W10C58P33 

M100C58P37 

02/17/98 

13:40:35 

02/17/98 

13:42:00 

N10C58P34 

N100C58P36 

02/17/98 

13:40:35 

02/17/98 

13:42:00 

N10C58P35 

M100C58P35 

02/17/98 

13:40:35 

02/17/98 

13:42:00 

N10C58P36 

N100C58P34 

02/17/98 

13:40:35 

02/17/98 

13:42:00 

M10C58P37 

N100C58P33 

02/17/98 

13:40:37 

02/17/98 

13:42:00 

N10C58P38 

N100C58P32 

02/17/98 

13:40:37 

02/17/98 

13:42:00 

N10C58P39 

N100C58P31 

02/17/98 

13:40:37 

02/17/98 

13:42:00 

M10C58P40 

N100C58P30 

02/17/98 

13:40:38 

02/17/98 

13:42:00 

M10C58P41 

N100C58P29 

02/17/98 

13:40:38 

02/17/98 

13:42:00 

M10C58P42 

N100C58P28 

02/17/98 

13:40:38 

02/17/98 

13:42:00 

N10C58P43 

N100C58P27 

02/17/98 

13:40:39 

02/17/98 

13:42:00 

M10C58P44 

N100C58P26 

02/17/98 

13:40:40 

02/17/98 

13:42:00 

'C58P45 

M100C58P25 

02/17/98 

13:40:40 

02/17/98 

13:42:00 

JC58P46 

M100C58P24 

02/17/98 

13:40:40 

02/17/98 

13:42:00 

M10C58P25 

M100C58P45 

02/17/98 

14:26:02 

02/17/98 

14:26:50 

N10C58P26 

M100C58P44 

02/17/98 

14:26:03 

02/17/98 

14:26:51 

N10C58P27 

N100C58P43 

02/17/98 

14:26:04 

02/17/98 

14:26:51 

M10C58P28 

N100C58P42 

02/17/98 

14:26:04 

02/17/98 

14:26:51 

M10C58P29 

M100C58P41 

02/17/98 

14:26:04 

02/17/98 

14:26:51 

M10C58P30 

N100C58P40 

02/17/98 

14:26:04 

02/17/98 

14:26:51 

N1QC58P31 

N100C58P39 

02/17/98 

14:26:06 

02/17/98 

14:26:52 

M10C58P32 

N100C58P38 

02/17/98 

14:26:06 

02/17/98 

14:26:52 

N10C56P33 

M100C58P37 

02/17/98 

14:26:06 

02/17/98 

14:26:53 

N10C58P34 

M100C58P36 ' 

02/17/98 

14:26:06 

02/17/98 

14:26:53 

M10C58P35 

M100C58P35 

02/17/98 

14:26:07 

02/17/98 

14:26:53 

M10C58P36 

N100C58P34 

02/17/98 

14:26:07 

02/17/98 

14:26:53 

M10C58P37 

N100C58P33 

02/17/98 

14:26:08 

02/17/98 

14:26:53 

N10C58P38 

M100C58P32 

02/17/98 

14:26:08 

02/17/98 

14:26:53 

N10C58P39 

MlOOC5SP3t 

02/17/98 

14:26:10 

02/17/98 

14:26:54 

N10C58P40 

H100C58P30 

02/17/98 

14;26;Q9 

02/17/98 

14;26;54 

M10C58P41 

N100C58P29 

02/17/98 

14:26:09 

02/17/98 

14:26:54 

K10C58P42 

N100C58P28 

02/17/98 

14:26:10 

02/17/98 

14:26:54 

N10C58P43 

M100C58P27 

02/17/98 

14:26:11 

02/17/98 

14:26:54 

M10C58P44 

N100C58P26 

02/17/98 

14:26:12 

02/17/98 

14:26:55 

H10C58P45 

N100C58P25 

02/17/96 

14:26:12 

02/17/98 

14:26:56 

M10C58P24 

N100C58P46 

02/17/98 

14:25:49 

02/17/98 

14:26:56 

N10C58P25 

N100C58P45 

02/17/98 

14:28:49 

02/17/98 

14:31:23 

"40C58P26 

M100C58P44 

02/17/98 

14:28:49 

02/17/98 

14:31:23 

C58P27 

N100C58P43 

02/17/98 

14:28:49 

02/17/98 

14:31:23 

M10C58P28 

Ml 00C58P42 

02/17/98 

U;28s49 

02/17/98 

14:31:23 

M10C58P29 

M100C58P41 

02/17/98 

14:28:49 

02/17/98 

14:31:23 

N10C58P30 

M100C58P40 

02/17/98 

14:28:49 

02/17/98 

14:31:23 

N10C58P31 

M100C58P39 

02/17/98 

14:28:52 

02/17/98 

14:31:24 

N10C58P32 

N100C58P38 

02/17/98 

14:28:52 

02/17/98 

14:31:24 

Duration 

ddd:hh:mm:ss 

000:00:01:26 

000:00:01:26 

000:00:01:24 

000:00:01:42 

000:00:01:26 

000:00:01:25 

000:00:01:25 

000:00:01:25 

000:00:01:25 

000:00:01:23 

000:00:01:23 

000:00:01:23 

000:00:01:22 

000:00:01:22 

000:00:01:22 

000:00:01:21 

000:00:01:20 

000:00:01:20 

000:00:01:20 

000:00:00:48 

000:00:00:48 

000:00:00:47 

000:00:00:47 

000:00:00:47 

000:00:00:47 

000:00:00:46 

000:00:00:46 

000:00:00:47 

000:00:00:47 

000:00:00:46 

000:00:00:46 

000:00:00:45 

000:00:00:45 

000:00:00:44 

000:00:00:45 

000:00:00:45 

000:00:00:44 

000:00:00:43 

000:00:00:43 

000:00:00:44 

000:00:01:07 

000:00:02:34 

000:00:02:34 

000:00:02:34 

000:00:02:34 

000:00:02:34 

000:00:02:34 

000:00:02:32 

000:00:02:32 


Call  Duration  Report  for  device  N10 
Mon  Feb  23  i1;5?;41  19?6 

From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:mm:ss 

rrm/dd/yy 

hh:mm:ss 

ddd:hh:mn:ss 

N10C58P33 

N100C58P37 

02/17/98  14:28:52 

02/17/98 

14:31:24 

000:00:02:32 

H10C58P24 

N100C58P46 

02/17/98  14:28:35 

02/17/98 

14:31:25 

000:00:02:50 

N10C56P34 

N100C58P36 

02/17/93  14:28:53 

02/17/98 

14:31:25 

000:00:02:32 

M10C58P35 

N100C58P35 

02/17/98  14:28:53 

02/17/98 

14:31:25 

000:00:02:32 

N10C58P36 

N1GQC58P34 

02/17/98  14:28:53 

02/17/98 

14:31:25 

000:00:02:32 

N10C58P37 

N100C58P33 

02/17/98  14:28:55 

02/17/98 

14:31:25 

000:00:02:30 

N10C58P38 

Ml OOC58P32 

02/17/98  14:28:55 

02/17/98 

14:31:25 

000:00:02:30 

N10C58P39 

N1 00C58P31 

02/17/98  14:28:55 

02/17/98 

14:31:25 

000:00:02:30 

M10C58P40 

M100C58P30 

02/17/98  14:28:56 

02/17/98 

14:31:25 

000:00:02:29 

M10C58P41 

M100C58P29 

02/17/98  14:28:56 

02/17/98 

14:31:25 

000:00:02:29 

K10C58P42 

M100C58P28 

02/17/98  14:28:56 

02/17/98 

14:31:25 

000:00:02:29 

N10C58P43 

M100C58P27 

02/17/98  14:28:57 

02/17/98 

14:31:25 

000:00:02:28 

N10C58P44 

N100C58P26 

02/17/98  14:28:58 

02/17/98 

14:31:25 

000:00:02:27 

N10C58P45 

N100C58P25 

02/17/98  14:28:58 

02/17/98 

14:31:25 

000:00:02:27 

N10C58R46 

N1O0C58P24 

02/17/98  14:28:58 

02/17/98 

14:31:25 

000:00:02:27 

N10C58P24 

N100C58P46 

02/17/98  14:32:29 

02/17/98 

14:32:49 

000:00:00:20 

M10C58P24 

N100C58P46 

02/17/98  14:33:23 

02/17/98 

14:33:43 

000:00:00:20 

:58P25 

M100C58P45 

02/17/98  14:34:08 

02/17/98 

14:36:18 

000:00:02:10 

JC58P26 

N100C58P44 

02/17/98  14:34:08 

02/17/98 

14:36:18 

000:00:02:10 

N10C58P27 

N100C58P43 

02/17/98  14:34:08 

02/17/98 

14:36:18 

000:00:02:10 

M10C58P28 

N100C58P42 

02/17/98  14:34:09 

02/17/98 

14:36:18 

000:00:02:09 

N10C58P29 

N100C58P41 

02/17/98  14:34:09 

02/17/98 

14:36:18 

000:00:02:09 

N10C58P30 

M100C58P4O 

02/17/98  14:34:09 

02/17/98 

14:36:18 

000:00:02:09 

N10C58P31 

M100C58P39 

02/17/98  14:34:11 

02/17/98 

14:36:19 

000:00:02:08 

M10C58P32 

M100C58P38 

02/17/98  14:34:11 

02/17/98 

14:36:19 

000:00:02:08 

M10C58P33 

M100C58P37 

02/17/98  14:34:11 

02/17/98 

14:36:19 

000:00:02:08 

N10C58P36 

Ml O0C58P34 

02/17/98  14:34:13 

02/17/98 

14:36:21 

000:00:02:08 

N1GC58P37 

M1O0C58P33 

02/17/98  14:34:14 

02/17/98 

14:36:21 

000:00:02:07 

N10C58P34 

M100C58P36 

02/17/98  14:34:12 

02/17/98 

14:36:21 

000:00:02:09 

N10C58P35 

M10CC58P35 

02/17/98  14:34:12 

02/17/98 

14:36:21 

000:00:02:09 

N10C58P38 

M100C58P32 

02/17/98  14:34:14 

02/17/98 

14:36:22 

000:00:02:08 

M10C58P39 

Ml 0CC58P31 

02/17/98  14:34:14 

02/17/98 

14:36:22 

000:00:02:08 

N10C58P40 

Ml 00C58P30 

02/17/98  14:34:15 

02/17/98 

14:36:22 

000:00:02:07 

N10C58P41 

Nl QQC58P29 

02/17/98  14:34:15 

02/17/98 

14:36:22 

000:00:02:07 

M10C58P42 

M10QC58P28 

02/17/98  14:34:15 

02/17/98 

14:36:23 

000:00:02:08 

K10C58P43 

N10OC58P27 

02/17/98  14:34:16 

02/17/98 

14:36:23 

000:00:02:07 

M10C58P44 

H100C58P26 

02/17/98  14:34:17 

02/17/98 

14:36:24 

000:00:02:07 

N1QC55P45 

M100C58P25 

02/17/98  14:34:17 

02/17/98 

14:36:24 

000:00:02:07 

N10C58P46 

N100C58P24 

02/17/98  14:34:17 

02/17/98 

14:36:24 

000:00:02:07 

M10CS8P24 

M100C58P46 

02/17/98  14:33:54 

02/17/98 

14:36:24 

000:00:02:30 

N10C58P25 

N10OC58P45 

02/17/98  14:38:44 

02/17/98 

14:41:34 

000:00:02:50 

N10C58P26 

M10OC58P44 

02/17/98  14:38:45 

02/17/98 

14:41:34 

000:00:02:49 

'C58P27 

N100C56P43 

02/17/98  14:38:45 

02/17/98 

14:41:34 

000:00:02:49 

-CS8P28 

N1O0C58P42 

02/ 1 7/98  14:38:45 

02/17/98 

14:41:34 

000:00:02:49 

N10C58P29 

N10QC56P41 

02/17/98  14:38:45 

02/17/96 

14:41:34 

000:00:02:49 

N10C58P30 

N100C58P40 

02/17/98  14:38:45 

02/17/98 

14:41:34 

000:00:02:49 

N10C58P31 

N100C58P39 

02/17/98  14:38:47 

02/17/98 

14:41:35 

000:00:02:48 

N1QC58P32 

N1Q0C58P3S 

02/17/98  14:38:47 

02/17/98 

14:41:35 

000:00:02:45 

M1QC58P33 

M100C58P37 

02/17/98  14:38:47 

02/17/98 

14:41:35 

000:00:02:48 

Call  Duration  Report  for  device  N10 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  * 

r  ime 

Disconnect  Time 

Port 

Port 

mm/dd/yy 

hh:rm:ss 

mm/dd/yy 

hh:mm:ss 

N10C58P24 

N100C58P46 

02/17/98 

14:38:31 

02/17/98 

14:41:36 

N10C58P34 

N100C58P36 

02/17/98 

14:38:48 

02/17/98 

14:41:36 

W70C58P35 

M100C58P35 

02/17/98 

14:38:48 

02/17/98 

14:41:36 

N10C58P36 

N100C58P34 

02/17/98 

14:38:48 

02/17/98 

14:41:36 

M10C58P37 

N100C58P33 

02/17/98 

14:38:49 

02/17/98 

14:41:36 

N10C58P38 

N100C58P32 

02/17/98 

14:38:50 

02/17/98 

14:41:36 

N10C58P39 

N100C58P31 

02/17/98 

14:38:50 

02/17/98 

14:41:36 

N10C58P40 

N100C58P30 

02/17/98 

14:38:51 

02/17/98 

14:41:36 

N10C58P41 

N100C58P29 

02/17/98 

14:38:51 

02/17/98 

14:41:36 

N10C58P42 

N100C58P28 

02/17/98 

14:38:51 

02/17/98 

14:41:36 

K10C58P43 

N100C58P27 

02/17/98 

14:38:52 

02/17/98 

14:41:36 

N1GC58P44 

N100C58P2.6 

02/17/98 

14:38:53 

02/17/98 

14:41:36 

N10C58P45 

M100C58P25 

02/17/98 

14:38:53 

02/17/98 

14:41:36 

N10C58P46 

N100C58P24 

02/17/98 

14:38:53 

02/17/98 

14:41:36 

N10C58P24 

N100C58P46 

02/17/98 

14:42:08 

02/17/98 

14:42:12 

N10C58P25 

N100C58P45 

02/17/98 

14:43:17 

02/17/98 

14:44:14 

N10C58P26 

N100C58P44 

02/17/98 

14:43:17 

02/17/98 

14:44:15 

C58P27 

N100C58P43 

02/17/98 

14:43:17 

02/17/98 

14:44:15 

X58P28 

N100C58P42 

02/17/98 

14:43:17 

02/17/98 

14:44:15 

N10C58P29 

N100C58P41 

02/17/98 

14:43:17 

02/17/98 

14:44:15 

N10C58P30 

N100C58P40 

02/17/98 

14:43:18 

02/17/98 

14:44:15 

N10C58P31 

M100C58P39 

02/17/98 

14:43:19 

02/17/98 

14:44:15 

H70C58P32 

N100C58P38 

02/17/98 

14:43:20 

02/17/98 

14:44:17 

N10C58P33 

N100C58P37 

02/17/98 

14:43:20 

02/17/98 

14:44:17 

N10C58P34 

M100C58P36 

02/17/98 

14:43:21 

02/17/98 

14:44:17 

K10C58P35 

N100C58P35 

02/17/98 

14:43:21 

02/17/98 

14:44:17 

N10C58P37 

N100C58P33 

02/17/98 

14:43:22 

02/17/98 

14:44:18 

N10C58P36 

N100C58P34 

02/17/98 

14:43:20 

02/17/98 

14:44:18 

N10C58P38 

N100C58P32 

02/17/98 

14:43:22 

02/17/98 

14:44:18 

N10C58P39 

N100C58P31 

02/17/98 

14:43:23 

02/17/98 

14:44:19 

N10C58P40 

N100C58P30 

02/17/98 

14:43:23 

02/17/98 

14:44:19 

N10C58P47 

N100C58P29 

02/17/98 

14:43:23 

02/17/98 

14:44:20 

N10C58P42 

N100C58P28 

02/17/98 

14:43:23 

02/17/98 

14:44:20 

N10C58P43 

N100C58P27 

02/17/98 

14:43:25 

02/17/98 

14:44:20 

N10C58P44 

H100C58P26 

02/17/98 

14:43:25 

02/17/98 

14:44:20 

N10C58P45 

N 1 OOC58P25 

02/17/98 

14:43:26 

02/17/98 

14:44:21 

N10C58P46 

N100C58P24 

02/17/98 

14:43:26 

02/17/98 

14:44:21 

H10C58P24 

N100C58P46 

02/17/98 

14:43:03 

02/17/98 

14:44:21 

W 1 0C58P25 

N100C58P45 

02/17/98 

15:10:27 

02/17/98 

15:18:33 

N10C58P26 

N100C58P44 

02/17/98 

15:10:27 

02/17/98 

15:18:33 

W10C58P27 

N1G0C58P43 

02/17/98 

15:10:28 

02/17/98 

15:18:34 

N10C58P28 

N100C58P42 

02/17/98 

15:10:28 

02/17/98 

15:18:34 

k,<rlC58P29 

N100C58P41 

02/17/98 

15:10:28 

02/17/98 

15:18:34 

:58P3Q 

K100C58P40 

02/17/98 

15:10:28 

02/17/98 

15:18:34 

1 0C58P31 

W100C58P39 

02/17/98 

15:10:30 

02/17/98 

15:18:34 

N10C58P32 

N100C58P38 

02/17/98 

15:10:30 

02/17/98 

15:18:34 

N10C58P33 

N100C58P37 

02/17/98 

15:10:30 

02/17/98 

15:18:35 

N10C58P34 

N100C58P36 

02/17/98 

15:10:31 

02/17/98 

15:18:35 

N10C58P35 

N100C58P35 

02/17/98 

15:10:31 

02/17/98 

15:18:35 

Duration 

ddd:hh:mm:ss 

000:00:03:05 

000:00:02:48 

000:00:02:48 

000:00:02:48 

000:00:02:47 

000:00:02:46 

000:00:02:46 

000:00:02:45 

000:00:02:45 

000:00:02:45 

000:00:02:44 

000:00:02:43 

000:00:02:43 

000:00:02:43 

000:00:00:04 

000:00:00:57 

000:00:00:58 

000:00:00:58 

000:00:00:58 

000:00:00:58 

000:00:00:57 

000:00:00:56 

000:00:00:57 

000:00:00:57 

000:00:00:56 

000:00:00:56 

000:00:00:56 

000:00:00:58 

000:00:00:56 

000:00:00:56 

000:00:00:56 

000:00:00:57 

000:00:00:57 

000:00:00:55 

000:00:00:55 

000:00:00:55 

000:00:00:55 

000:00:01:18 

000:00:08:06 

000:00:08:06 

000:00:08:06 

000:00:08:06 

000:00:08:06 

000:00:08:06 

000:00:08:04 

000:00:08:04 

000:00:08:05 

000:00:08:04 

000:00:08:04 


Call  Duration  Report  for  device  N10 
Mon  Fob  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Terminat ion 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

fim/dd/yy  hh:nn:ss 

mm/dd/yy  hh:rm:s$ 

ddd:hh:mm:ss 

M10C58P36 

N1G0C58P34 

02/17/98  15:10:31 

02/17/98 

15:18:35 

000:00:08:04 

N10C58P37 

N100C58P33 

02/17/98  15:10:32 

02/17/98 

15:18:35 

000:00:08:03 

N10C58P38 

N100C58P32 

02/17/98  15:10:33 

02/17/98 

15:18:36 

000:00:08:03 

N10C58P39 

N100C58P31 

02/17/98  15:10:33 

02/17/98 

15:18:36 

000:00:08:03 

N10C58P40 

N100C58P30 

02/17/98  15:10:33 

02/17/98 

15:18:36 

000:00:08:03 

N 1 0C58P4 1 

N 1 00C58P29 

02/17/98  15:10:33 

02/17/98 

15:18:36 

000:00:08:03 

N10C58P42 

N100C58P28 

02/17/98  15:10:34 

02/17/98 

15:18:37 

000:00:08:03 

N10C58P43 

N100C58P27 

02/17/98  15:10:35 

02/17/98 

15:18:37 

000:00:08:02 

N10C58P44 

M10OC58P26 

02/17/98  15:10:36 

02/17/98 

15:18:38 

000:00:08:02 

N10C58P45 

N100C58P25 

02/17/98  15:10:36 

02/17/98 

15:18:38 

000:00:08:02 

K10C58P46 

N100C58P24 

02/17/98  15:10:36 

02/17/98 

15:18:38 

000:00:08:02 

M10C58P24 

N100C58P46 

02/17/98  15:10:14 

02/17/98 

15:18:39 

000:00:08:25 

N1QC25P41 

N5C26P6 

02/17/98  06:28:53 

02/17/98 

15:23:38 

000:08:54:45 

N10C25P42 

N8C26P5 

02/17/98  06:28:53 

02/17/98 

15:23:38 

000:08:54:45 

N10C25P43 

N8C26P4 

02/17/98  06:28:53 

02/17/98 

15:23:39 

000:08:54:46 

N10C25P44 

N8C26P3 

02/17/98  06:28:53 

02/17/98 

15:23:39 

000:08:54:46 

N10C25P45 

N8C26P2 

02/17/98  06:28:52 

02/17/98  15:23:39 

000:08:54:47 

'C25P46 

N8C26P24 

02/17/98  06:28:45 

02/17/98  15:23:39 

000:08:54:54 

JC58P25 

N100C58P45 

02/17/98  16:21:25 

02/17/98 

16:23:42 

000:00:02:17 

N10C58P26 

N10OC58P44 

02/17/98  16:21:25 

02/17/98 

16:23:42 

000:00:02:17 

N10C58P27 

N100C58P43 

02/17/98  16:21:25 

02/17/98  16:23:42 

000:00:02:17 

N 1 0C58P2S 

N100C58P42 

02/17/98  16:21:25 

02/17/98  16:23:42 

000:00:02:17 

W10C58P29 

N10QC58P41 

02/17/98  16:21:25 

02/17/98  16:23:42 

000:00:02:17 

W10C58P30 

N100C58P40 

02/17/98  16:21:25 

02/17/98 

16:23:42 

000:00:02:17 

N10C58P31 

N100C58P39 

02/17/98  16:21:27 

02/17/98 

16:23:42 

000:00:02:15 

W10C58P32 

N100C58P38 

02/17/98  16:21:28 

02/17/98 

16:23:43 

000:00:02:15 

N10C58P33 

N100C58P37 

02/17/98  16:21:28 

02/17/98  16:23:43 

000:00:02:15 

N10C58P34 

N100C58P36 

02/17/98  16:21:28 

02/17/98 

16:23:43 

000:00:02:15 

M10C58P35 

N100C58P35 

02/17/98  16:21:29 

02/17/98 

16:23:43 

000:00:02:14 

N10C58P36 

N100C58P34 

02/17/98  16:21:29 

02/17/98 

16:23:43 

000:00:02:14 

N10C58P37 

M100C58P33 

02/17/98  16:21:31 

02/17/98 

16:23:44 

000:00:02:13 

H10C58P38 

M10QC58P32 

02/17/98  16:21:31 

02/17/98  16:23:44 

000:00:02:13 

W10C58P39 

M100C5SP31 

02/17/98  16:21:31 

02/17/98 

16:23:44 

000:00:02:13 

N10C58P40 

N100C58P30 

02/17/98  16:21:31 

02/17/98  16:23:44 

000:00:02:13 

W10C58P41 

Ml 00C58P29 

02/17/98  16:21:32 

02/17/98  16:23:45 

000:00:02:13 

N10C58P42 

M100C58P28 

02/17/98  16:21:32 

02/17/98 

16:23:45 

000:00:02:13 

N10C58P43 

M100C58P27 

02/17/98  16:21:33 

02/17/98  16:23:45 

000:00:02:12 

N10C58P44 

W1C0C53P26 

02/17/98  16:21:33 

02/17/98 

16:23:45 

000:00:02:12 

N10C58P45 

N100C58P25 

02/17/98  16:21:34 

02/17/98  16:23:46 

000:00:02:12 

M10C58P46 

N100C58P24 

02/17/98  16:21:34 

02/17/98 

16:23:46 

000:00:02:12 

N10C58P24 

N100C58P46 

02/17/98  16:21:11 

02/17/98 

16:23:47 

000:00:02:36 

N1QC55P3 

N14C10P0 

02/12/98  07:37:45 

02/17/98 

17:03:24 

005:09:25:39 

lM0C27P3 

M14C22P0 

02/12/98  07:37:25 

02/17/98 

17:03:36 

005:09:26:11 

C58P26 

N100C58P45 

02/17/98  18:12:59 

02/17/98  18:15:35 

000:00:02:36 

N1 0C58P27 

Ml 0OC58P44 

02/17/98  18:13:00 

02/17/98 

18:15:36 

000:00:02:36 

N10C58P28 

N100C58P43 

02/17/98  18:13:00 

02/17/98 

18:15:36 

000:00:02:36 

H10C58P29 

W100C58P42 

02/17/98  18:13:00 

02/17/98 

18:15:36 

000:00:02:36 

K10C58P30 

N100C58P41 

02/17/98  18:13:00 

02/17/98 

18:15:36 

000:00:02:36 

M10C58P31 

N100C58P40 

02/17/98  18:13:00 

02/17/98 

18:15:36 

000:00:02:36 

Call  Duration  Report  for  device  N10 
Mon  Feb  23  11:59:41  1996 

From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:rm:ss 

rrm/dd/yy 

hh:mm:ss 

ddd:hh:nm:ss 

N10C58P32 

N100C58P39 

02/17/98  18:13:01 

02/17/98 

18:15:37 

000:00:02:36 

N10C58P33 

N100C58P38 

02/17/98  18:13:02 

02/17/98 

18:15:37 

000:00:02:35 

N10C58P34 

N100C56P37 

02/17/98  18; 13;02 

02/17/96 

18:15:37 

000 ; 00 ; 02 : 35 

N10C58P35 

N100C58P36 

02/17/98  18:13:03 

02/17/98 

18:15:38 

000:00:02:35 

K1QC58P36 

N100C58P35 

02/17/95  18:13:03 

02/17/98 

18:15:38 

000:00:02:35 

N10C58P37 

N100C58P34 

02/17/98  18:13:03 

02/17/98 

18:15:38 

000:00:02:35 

N10C58P38 

N100C58P33 

02/17/98  18:13:04 

02/17/98 

18:15:38 

000:00:02:34 

N10C58P39 

N100C58P32 

02/17/98  18:13:05 

02/17/98 

18:15:39 

000:00:02:34 

N10C58P40 

N100C58P31 

02/17/98  18:13:05 

02/17/98 

18:15:39 

000:00:02:34 

N1QC58P41 

N100C58P30 

02/17/98  18:13:05 

02/17/98 

18:15:39 

000:00:02:34 

N10C58P42 

N100C58P29 

02/17/98  18:13:06 

02/17/98 

18:15:40 

000:00:02:34 

N10C58P43 

N100C58P28 

02/17/98  18:13:06 

02/17/98 

18:15:40 

000:00:02:34 

N10C58P44 

N100C58P27 

02/17/98  18:13:07 

02/17/98 

18:15:40 

000:00:02:33 

M10C58P45 

N100C58P26 

02/17/98  18:13:08 

02/17/98 

18:15:41 

000:00:02:33 

H10C58P46 

N100C58P25 

02/17/98  18:13:08 

02/17/98 

18:15:41 

000:00:02:33 

N10C58P25 

N100C58P46 

02/17/98  18:12:45 

02/17/98 

18:15:41 

000:00:02:56 

N10C56P26 

N100C58P45 

02/18/98  00:57:47 

02/18/98 

01:00:30 

000:00:02:43 

1C58P27 

M100C58P44 

02/18/98  00:57:47 

02/18/98 

01:00:30 

000:00:02:43 

(0C58P28 

N100C58P43 

02/18/98  00:57:47 

02/18/98 

01:00:30 

000:00:02:43 

N10C5SP29 

N100C58P42 

02/18/98  00:57:47 

02/18/98 

01:00:30 

000:00:02:43 

N10C58P30 

N100C58P41 

02/18/98  00:57:4 7 

02/18/98 

01:00:30 

000:00:02:43 

N10C58P31 

N10QC58P4Q 

02/18/98  00:57:47 

02/18/98 

01:00:30 

000:00:02:43 

W10C5SP32 

N100C58P39 

02/18/98  00:57:49 

02/18/98 

01:00:30 

000:00:02:41 

N10C58P33 

M100C58P38 

02/18/98  00:57:50 

02/18/98 

01:00:31 

000:00:02:41 

N10C58P34 

‘ W10CC58P37 

02/18/98  00:57:50 

02/18/98 

01:00:31 

000:00:02:41 

N10C58P35 

N100C58P36 

02/18/98  00:57:50 

02/18/98 

01:00:31 

000:00:02:41 

N10C58P36 

N100C58P35 

02/18/98  00:57:50 

02/18/98 

01:00:31 

000:00:02:41 

N10C58P37 

Ml OOC58P34 

02/18/98  00:57:50 

02/18/98 

01:00:31 

000:00:02:41 

N10C58P38 

N100C58P33 

02/18/98  00:57:52 

02/18/98 

01:00:32 

000:00:02:40 

K10C58P39 

N100C5SP32 

02/18/98  00:57:53 

02/18/98 

01:00:32 

000:00:02:39 

K10C58P4Q 

N100C58P31 

02/18/98  00:57:53 

02/18/98 

01:00:32 

000:00:02:39 

M10C5SP41 

N10CC58P30 

02/18/98  00:57:53 

02/18/98 

01:00:32 

000:00:02:39 

K10C58P42 

N100C58P29 

02/18/98  00:57:54 

02/18/98 

01:00:33 

000:00:02:39 

N10C58P43 

N100C58P28 

02/18/98  00:57:54 

02/18/98 

01:00:33 

000:00:02:39 

N10C58P44 

N1QQC58P27 

02/18/98  00:57:55 

02/18/98 

01:00:33 

000:00:02:38 

N10C58P45 

N100C58P26 

02/18/98  00:57:56 

02/18/98 

01:00:34 

000:00:02:38 

W10C5SP46 

M10CC58P25 

02/18/98  00:57:56 

02/18/98 

01:00:34 

000:00:02:38 

K10C58P25 

N100C58P46 

02/18/98  00:57:33 

02/18/98 

01:00:34 

000:00:03:01 

W10C25P41 

M8C26P30 

02/18/98  06:33:24 

02/18/98 

06:33:44 

000:00:00:20 

N10C25P42 

N8C26P29 

02/18/98  06:33:24 

02/18/98 

06:33:44 

000:00:00:20 

K10C25P43 

N8C26P28 

02/18/98  06:33:24 

02/18/98 

06:33:45 

000:00:00:21 

N10C25P44 

N8C26P27 

02/18/98  06:33:24 

02/18/98 

06:33:45 

000:00:00:21 

0C25P45 

N8C26P26 

02/18/98  06:33:24 

02/18/98 

06:33:45 

000:00:00:21 

JC25P46 

U8C26P25 

02/18/98  06:33:17 

02/18/98 

06:33:45 

000:00:00:28 

K10C25F41 

N0G2GP3Q 

02/10/90  06:34:21 

02/13/96 

06; 59; 26 

000:00:25:07 

N10C25P42 

W8C26P29 

02/18/98  06:34:21 

02/18/98 

06:59:29 

000:00:25:08 

N10C25P43 

N8C26P28 

02/18/98  06:34:20 

02/18/98 

06:59:29 

000:00:25:09 

N10C25P44 

N8C26P27 

02/18/98  06:34:20 

02/18/98 

06:59:29 

000:00:25:09 

N1DC25P45 

N8C26P26 

02/18/98  06:34:20 

02/18/98 

06:59:29 

000:00:25:09 

Call  Duration  Report  for  device  W 1 0 
Mon  Feb  ZZ  11:59:41  1996 

From  02/16/96  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:mm:ss 

rrcn/dd/yy 

hh  :rm:ss 

ddd:hh:mm:ss 

N10C25P46 

N8C26P25 

02/18/93  06:34:12 

02/18/98 

06:59:29 

000:00:25:17 

N10C25P41 

N8C26P36 

02/18/98  07:00:10 

02/18/98 

07:05:33 

000:00:05:23 

N10C25P42 

N8C26P35 

02/18/98  07 ; 00 ; 1 1 

02/18/98 

07:05:34 

000:00:05; 23 

N10C25P43 

N8C26P34 

02/18/98  07:00:10 

02/18/98 

07:05:34 

000:00:05:24 

N10C25P44 

N0C26P33 

02/15/98  07:00:10 

02/18/98 

07:05:34 

000:00:05:24 

N10C25P45 

N8C26P32 

02/18/98  07:00:09 

02/18/98 

07:05:34 

000:00:05:25 

N10C25P46 

N8C26P31 

02/18/98  07:00:02 

02/18/98 

07:05:34 

000:00:05:32 

N10C25P41 

N8C26P31 

02/18/98  07:05:57 

02/18/98 

07:06:17 

000:00:00:20 

N10C25P42 

N8C26P30 

02/18/98  07:05:56 

02/18/98 

07:06:17 

000:00:00:21 

N10C25P43 

N8C26P29 

02/18/98  07:05:56 

02/18/98 

07:06:17 

000:00:00:21 

K10C25P44 

N8C26P28 

02/18/98  07:05:55 

02/18/98 

07:06:17 

000:00:00:22 

N10C25P45 

N8C26P27 

02/18/98  07:05:56 

02/18/98 

07:06:18 

000:00:00:22 

N10C25P46 

M8C26P25 

02/18/98  07:05:49 

02/18/98 

07:06:18 

000:00:00:29 

M10C25P41 

N8C26P31 

02/18/98  07:06:41 

02/18/98 

07:07:12 

000:00:00:31 

N1DC25P42 

H8C26P30 

02/18/98  07:06:41 

02/18/98 

07:07:12 

000:00:00:31 

M10C25P43 

M8C26P29 

02/18/98  07:06:40 

02/18/98 

07:07:12 

000:00:00:32 

N10C25P44 

N8C26P28 

02/18/98  07:06:39 

02/18/98 

07:07:12 

000:00:00:33 

0C25P45 

M8C26P27 

02/18/98  07:06:39 

02/18/98 

07:07:12 

000:00:00:33 

.0C25P46 

M8C26P25 

02/18/98  07:06:32 

02/18/98 

07:07:12 

000:00:00:40 

K10C25P41 

N8C26P43 

02/18/98  07:07:33 

02/18/98 

07:07:52 

000:00:00:19 

N10C25P42 

M8C26P35 

02/18/98  07:07:32 

02/18/98 

07:07:52 

000:00:00:20 

N1QC25P43 

N8C26P33 

02/18/98  07:07:32 

02/18/98 

07:07:52 

000:00:00:20 

N10C25P44 

N8C26P31 

02/18/98  07:07:31 

02/18/98 

07:07:52 

000:00:00:21 

M10C25P45 

N8C26P29 

02/18/98  07:07:31 

02/18/98 

07:07:52 

000:00:00:21 

W10C25P46 

M8C26P26 

02/18/98  07:07:24 

02/18/98 

07:07:52 

000:00:00:28 

N10C25P40 

N100C57P0 

02/18/98  06:46:28 

02/18/98 

07:52:10 

000:01:05:42 

N10C25P35 

N100C57P5 

02/18/98  06:46:30 

02/18/98 

07:52:10 

000:01:05:40 

N10C25P36 

N100C57P4 

02/18/98  06:46:30 

02/18/98 

07:52:10 

000:01:05:40 

N10C25P37 

N100C57P3 

02/18/98  06:46:29 

02/18/98 

07:52:10 

000:01:05:41 

N10C25P38 

M100C57P2 

02/18/98  06:46:30 

02/18/98 

07:52:11 

000:01:05:41 

N10C25P39 

N10QC57P1 

02/18/98  06:46:29 

02/18/98 

07:52:11 

000:01:05:42 

M10C25P41 

H8C2&P43 

02/18/98  07:08:53 

02/18/98 

08:32:09 

000:01:23:16 

N10C25P42 

N8C26P35 

02/18/98  07:08:52 

02/18/98 

08:32:09 

000:01:23:17 

N1CC25P43 

N8C26P33 

02/18/98  07:08:52 

02/18/98 

08:32:09 

000:01:23:17 

N10C25P44 

N8C26P31 

02/18/98  07:08:51 

02/18/98 

08:32:09 

000:01:23:18 

N10C25P45 

N8C26P29 

02/18/98  07:08:52 

02/18/98 

08:32:10 

000:01:23:18 

M10C25P46 

H8C26P26 

02/18/98  07:08:45 

02/18/98 

08:32:10 

000:01:23:25 

N10C25P41 

N8C26P35 

02/15/98  08:32:37 

02/18/98 

08:32:55 

000:00:00:18 

K10C25P42 

N8C26P33 

02/18/98  08:32:36 

02/18/98 

08:32:55 

000:00:00:19 

N10C25P43 

M8C26P31 

02/18/98  08:32:36 

02/18/98 

08:32:55 

000:00:00:19 

N10C25P44 

N8C26P29 

02/18/98  08:32:35 

02/18/98 

08:32:55 

000:00:00:20 

N1GC25P45 

N8C26P27 

02/18/98  08:32:35 

02/18/98 

08:32:55 

000:00:00:20 

•0C25P46 

N8C26P10 

02/18/98  08:32:28 

02/18/98 

08:32:55 

000:00:00:27 

JC25PO 

H11C26P24 

02/12/98  12:47:37 

02/18/98 

08:51:58 

005:20:04:21 

N10C25P41 

N3C26P33 

02/15/98  06:34 ; 1? 

02/18/96 

09:00:30 

000:00:26:11 

H10C25P42 

N8C26P29 

02/18/98  08:34:20 

02/18/98 

09:00:31 

000:00:26:11 

K10C25P43 

N8C26P26 

02/18/98  08:34:19 

02/18/98 

09:00:31 

000:00:26:12 

N10C25P44 

N8C26P22 

02/18/98  08:34:19 

02/18/98 

09:00:31 

000:00:26:12 

M10C25P45 

W8C26P18 

02/18/98  08:34:18 

02/18/98 

09:00:31 

000:00:26:13 

Call  Duration  Report  for  device  NIC 
Mon  Feb  23  11:59:41  1998 

From  02/16/9S  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

rnn/dd/yy  hh:mm:ss 

mm/dd/yy  hh:mm:ss 

ddd:hh :mm:ss 

N10C25P46 

N8C26P10 

02/18/98  08:34:11 

02/18/98  09:00:31 

000:00:26:20 

N1GC25P41 

N8C26P16 

02/18/98  09:00:50 

02/18/98  09:01:10 

000:00:00:20 

M10C25P42 

N8C26P15 

02/18/98  09;00;50 

02/18/98  09:01:10 

000:00:00:20 

M10C25P43 

N8C26P14 

02/18/98  09:00:49 

02/18/98  09:01:10 

000:00:00:21 

N10C25P44 

N8C26P13 

02/18/98  09:00:49 

02/18/98  09:01:10 

000:00:00:21 

H10C25P45 

N8C26P11 

02/18/98  09:00:48 

02/18/98  09:01:10 

000:00:00:22 

N1GC25P46 

N8C26P9 

02/18/98  09:00:41 

02/18/98  09:01:10 

000:00:00:29 

N10C25P41 

N8C26P15 

02/18/98  09:01:29 

02/18/98  09:17:12 

000:00:15:43 

N10C25P42 

N8C26P14 

02/18/98  09:01:29 

02/18/98  09:17:13 

000:00:15:44 

N10C25P43 

N8C26P13 

02/18/98  09:01:28 

02/18/98  09:17:13 

000:00:15:45 

K10C25P44 

N8C26P12 

02/18/98  09:01:28 

02/18/9 8  09:17:13 

000:00:15:45 

N10C25P45 

N8C26P11 

02/18/98  09:01:28 

02/18/98  09:17:13 

000:00:15:45 

N10C25P46 

M8C26P9 

02/18/98  09:01:20 

02/18/98  09:17:13 

000:00:15:53 

N10C25P41 

K8C26P27 

02/18/98  09:17:38 

02/18/98  12:12:35 

000:02:54:57 

N10C25P42 

N8C26P26 

02/18/98  09:17:39 

02/18/98  12:12:36 

000:02:54:57 

N10C25P43 

N8C26P22 

02/18/98  09:17:38 

02/18/98  12:12:36 

000:02:54:58 

N10C25P44 

N8C26P20 

02/18/98  09:17:38 

02/13/98  12:12:36 

000:02:54:58 

'C25P45 

N8C26P18 

02/18/98  09:17:37 

02/18/9 8  12:12:36 

000:02:54:59 

JC25P46 

N8C26P10 

02/18/98  09:17:30 

02/18/98  12:12:36 

000:02:55:06 

N10C25P41 

N8C26P27 

02/18/98  12:15:11 

02/18/98  12:21:29 

000:00:06:18 

N10C25P42 

K8C26P26 

02/18/98  12:15:10 

02/18/98  12:21:29 

000:00:06:19 

N10C25P43 

N8C26P22 

02/18/98  12:15:10 

02/18/98  12:21:29 

000:00:06:19 

N10C25P44 

N8C26P20 

02/18/98  12:15:09 

02/18/98  12:21:29 

000:00:06:20 

W10C25P45 

K8C26P18 

02/18/98  12:15:10 

02/18/98  12:21:30 

000:00:06:20 

N10C25P46 

N8C26P10 

02/18/98  12:15:03 

02/18/98  12:21:30 

000:00:06:27 

N10C25P46 

N8C26P10 

02/18/98  12:22:06 

02/18/98  12:23:04 

000:00:00:58 

H10C25P45 

M8C26P18 

02/18/98  12:22:22 

02/18/98  12:23:04 

000:00:00:42 

N1QC58P26 

N100C58P45 

02/18/98  11:55:14 

02/18/98  12:32:36 

000:00:37:22 

H10C58P27 

N100C58P44 

02/18/98  11:55:15 

02/18/98  12:32:37 

000:00:37:22 

K10C5SP2S 

N100C58P43 

02/18/98  11:55:15 

02/18/98  12:32:37 

000:00:37:22 

K10C58P29 

N100C58P42 

02/18/98  11:55:15 

02/18/98  12:32:37 

000:00:37:22 

N10C58P30 

N100C58P41 

02/18/98  11:55:15 

02/18/98  12:32:37 

000:00:37:22 

N10C58P31 

N10QC58P40 

02/18/98  11:55:15 

02/18/98  12:32:37 

000:00:37:22 

W10C58P32 

N100C58P39 

02/18/98  11:55:17 

02/18/98  12:32:38 

000:00:37:21 

N10C58P33 

N100C58P38 

02/18/98  11:55:18 

02/18/98  12:32:39 

000:00:37:21 

N10C58P34 

Hi 00C58P37 

02/18/98  11:55:18 

02/18/98  12:32:39 

000:00:37:21 

N10C58P35 

N100C58P36 

02/18/98  11:55:18 

02/18/98  12:32:39 

000:00:37:21 

K10C58P36 

N100C58P35 

02/18/98  11:55:18 

02/18/98  12:32:39 

000:00:37:21 

W10C58P37 

H100C58P34 

02/18/98  11:55:19 

02/18/98  12:32:40 

000:00:37:21 

N10C58P38 

N1C0C58P33 

02/18/98  11:55:20 

02/18/98  12:32:40 

000:00:37:20 

N10C58P39 

H100C58P32 

02/18/98  11:55:20 

02/18/98  12:32:40 

000:00:37:20 

N10C58P40 

N100C58P31 

02/18/98  11:55:21 

02/18/98  12:32:40 

000:00:37:19 

'  *nc58P41 

N100C58P30 

02/18/98  11:55:22 

02/18/98  12:32:41 

000:00:37:19 

X58P42 

H100C58P29 

02/18/98  11:55:22 

02/18/98  12:32:41 

000:00:37:19 

r.  J  0C58P43 

H100C58P28 

02/18/98  1 1 *55*22 

02/18/98  12:32:41 

000:00:37:19 

N10C58P44 

N100C58P27 

02/18/98  11:55:22 

02/18/98  12:32:41 

000:00:37:19 

W10C58P45 

N100C58P26 

02/18/98  11:55:23 

02/18/98  12:32:41 

000:00:37:18 

M10CS8P46 

H100C58P25 

02/18/98  11:55:23 

02/18/98  12:32:42 

000:00:37:19 

N10C58P25 

N100C58P46 

02/18/98  11:55:00 

02/18/98  12:32:42 

000:00:37:42 

call  Duration  Report  for  device  mio 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Port 

Port 

nm/dd/yy  hh:nrm:ss 

mm/dd/yy 

hhimrruss 

N10C58P25 

N100C58P46 

02/18/98  12:32:50 

02/18/98 

12:33:10 

N10C58P26 

N100C58P45 

02/18/98  12:38:19 

02/18/98 

12:45:08 

W10C58P27 

W100C58P44 

02/18/98  12:38:19 

02/18/98 

12:45:08 

N10C58P28 

N100C58P43 

02/18/98  12:38:19 

02/18/98 

12:45:08 

N10C58P29 

N100C58P42 

02/18/98  12:38:20 

02/18/98 

12:45:09 

H10C58P30 

M100C58P41 

02/18/98  12:38:20 

02/18/98 

12:45:09 

N10C56P31 

N100C58P40 

02/18/98  12:38:20 

02/18/98 

12:45:09 

N10C58P32 

N100C58P39 

02/18/98  12:38:22 

02/18/98 

12:45:09 

H10C58P33 

N100C58P38 

02/18/98  12:38:22 

02/18/98 

12:45:09 

N10C58P34 

N100C58P37 

02/18/98  12:38:22 

02/18/98 

12:45:09 

N10C58P35 

N100C58P36 

02/18/98  12:38:22 

02/18/98 

12:45:09 

N10C58P36 

N100C58P35 

02/18/98  12:38:23 

02/18/98 

12:45:10 

N10C58P37 

M100C58P34 

02/18/98  12:38:23 

02/18/98 

12:45:10 

N10C58P38 

N100C5SP33 

02/18/98  12:38:25 

02/18/98 

12:45:11 

N10C58P39 

M100C58P32 

02/18/98  12:38:25 

02/18/98 

12:45:11 

N10C58P40 

N100C58P31 

02/18/98  12:38:25 

02/18/98 

12:45:11 

N10C58P41 

N100C58P30 

02/18/98  12:38:26 

02/18/98 

12:45:1* 

-58P42 

M100C58P29 

02/18/98  12:38:26 

02/18/98 

12:45:12 

JC58P43 

M100C5SP28 

02/18/98  12:38:27 

02/18/98 

12:45:13 

M10C58P44 

N100C58P27 

02/18/98  12:38:27 

02/18/98 

12:45:13 

N1QC58P45 

H100C58P26 

02/18/98  12:38:27 

02/18/98 

12:45:13 

N10C58P46 

M100C58P25 

02/18/98  12:38:28 

02/18/98 

12:45:13 

N10C58P25 

N100C58P46 

02/18/98  12:38:05 

02/18/98 

12:45:13 

N10C25PO 

N1 1C26P24 

02/18/98  08:55:29 

02/18/98 

12:54:17 

N10C58P26 

N100C58P45 

02/18/98  13:20:02 

02/18/98 

13:30:01 

N10C58P27 

M100C58P44 

02/18/98  13:20:02 

02/18/98 

13:30:02 

N10C58P28 

W100C58P43 

02/18/98  13:20:02 

02/18/98 

13:30:02 

N10C5SP29 

N100C58P42 

02/18/98  13:20:03 

02/18/98 

13:30:02 

N10C58P30 

N100C58P41 

02/18/98  13:20:03 

02/18/98 

13:30:02 

N10C58P31 

M100C58P40 

02/18/98  13:20:03 

02/18/98 

13:30:02 

N10C58P32 

N100C58P39 

02/18/98  13:20:04 

02/18/98 

13:30:02 

N10C58P33 

M100C58P38 

02/18/98  13:20:05 

02/18/98 

13:30:04 

K10C58P34 

N100C58P37 

02/18/98  13:20:05 

02/18/98 

13:30:04 

K10C5SP35 

N100C58P36 

02/18/98  13:20:06 

02/18/98 

13:30:04 

N10C58P36 

N10QC58P35 

02/18/98  13;20;06 

02/18/98 

13:30:04 

N10C58P37 

N100C58P34 

02/18/98  13:20:06  . 

02/18/98 

13:30:04 

N10C58P38 

N100C58P33 

02/18/98  13:20:07 

02/18/98 

13:30:04 

N10C58P39 

N100C58P32 

02/18/98  13:20:08 

02/18/98 

13:30:05 

N10C58P40 

N100C58P31 

02/18/98  13:20:08 

02/18/98 

13:30:06 

K10C58P41 

N100C58P30 

02/18/98  13:20:09 

02/18/98 

13:30:07 

N10C58P42 

N100C58P29 

02/18/98  13:20:09 

02/18/98 

13:30:07 

N10C58P43 

N100C58P28 

02/18/98  13:20:10 

02/18/98 

13:30:08 

‘‘"‘C58P44 

N 1 00C58P27 

02/18/98  13:20:10 

02/18/98 

13:30:08 

C58P45 

N10CC58P26 

02/18/98  13:20:10 

02/18/98 

13:30:08 

*10C58P46 

W 1 00C58P25 

02/18/98  13:20:11 

02/18/98 

13:30:08 

N10C58P25 

N100C58P46 

02/18/98  13:19:48 

02/18/98 

13:30:08 

N10C25P35 

N8C26P17 

02/18/98  14:27:29 

02/18/98 

14:28:55 

N10C25P36 

N8C26P16 

02/18/98  14:27:28 

02/18/98 

14:28:55 

N10C25P37 

N8C26P7 

02/18/98  14:27:27 

02/18/98 

14:28:55 

Duration 

ddd:hh:mm:ss 

000:00:00:20 

000:00:06:49 

000:00:06:49 

000:00:06:49 

000:00:06:49 

000:00:06:49 

000:00:06:49 

000:00:06:47 

000:00:06:47 

000:00:06:47 

000:00:06:47 

000:00:06:47 

000:00:06:47 

000:00:06:46 

000:00:06:46 

000:00:06:46 

000:00:06:46 

000:00:06:46 

000:00:06:46 

000:00:06:46 

000:00:06:46 

000:00:06:45 

000:00:07:08 

000:03:58:48 

000:00:09:59 

000:00:10:00 

000:00:10:00 

000:00:09:59 

000:00:09:59 

000:00:09:59 

000:00:09:58 

000:00:09:59 

000:00:09:59 

000:00:09:58 

000:00:09:58 

000:00:09:58 

000:00:09:57 

000:00:09:57 

000:00:09:58 

000:00:09:58 

000:00:09:58 

000:00:09:58 

000:00:09:58 

000:00:09:58 

000:00:09:57 

000:00:10:20 

000:00:01:26 

000:00:01:27 

000:00:01:28 


Call  Duration  Report  for  device  N 1 0 
Mon  Peb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Pert 

Port 

mm/dd/yy 

hh :mm; ss 

mm/dd/yy 

hh:mn:ss 

N10C25P38 

N8C26P6 

02/18/98 

14:27:28 

02/18/98 

14:28:56 

N1QC25P39 

N8C26P4 

02/18/98 

14:27:27 

02/18/98 

14:28:56 

N10C25P40 

N8C26P3 

02/18/98 

14:27:24 

02/18/98 

14:28:56 

N10C25P41 

N8C26P27 

02/18/98 

12:24:47 

02/18/98 

15:28:04 

N10C25P42 

N8C26P26 

02/18/98 

12:24:46 

02/18/98 

15:28:04 

M10C25P43 

N8C26P22 

02/18/98 

12:24:47 

02/18/98 

15:28:05 

N1DC25P44 

N8C26P20 

02/18/98 

12:24:46 

02/18/98 

15:28:05 

N10C25P45 

N8C26P18 

02/18/98 

12:24:45 

02/18/98 

15:28:05 

N10C25P46 

N8C26P10 

02/18/98 

12:24:38 

02/18/98 

15:28:05 

M10C25P46 

N8C26P0 

02/18/98 

15:28:1 8 

02/18/98 

15:28:18 

M10C25P46 

N8C26P0 

02/18/98 

15:28:42 

02/18/98 

15:28:42 

N10C58P47 

N10C43P5 

02/10/98 

07:59:53 

02/18/98 

16:11:12 

k10C25P35 

N8C26P17 

02/18/98 

14:30:46 

02/18/98 

17:08:33 

N10C25P36 

N8C26P16 

02/18/98 

14:30:45 

02/18/98 

17:08:33 

N10C25P37 

N8C26P7 

02/18/98 

14:30:44 

02/18/98 

17:08:33 

K10C25P3S 

N3C26P6 

02/18/98 

14:30:45 

02/18/98 

17:08:34 

N10C25P39 

N8C26P4 

02/18/98 

14:30:44 

02/18/98 

17:08:34 

'25P40 

N8C26P3 

02/18/98 

14:30:42 

02/18/98 

17:08:34 

X58P25 

N100C58P45 

02/19/98 

00:57:49 

02/19/98 

01:00:20 

N10C58P26 

N100C58P44 

02/19/98 

00:57:49 

02/19/98 

01:00:20 

N10C58P27 

N100C58P43 

02/19/98 

00:57:49 

02/19/98 

01:00:20 

N10C58P28 

W100C58P42 

02/19/98 

00:57:49 

02/19/98 

01:00:20 

N10C58P29 

N100C58P41 

02/19/98 

00:57:49 

02/19/98 

01:00:20 

K10C58P30 

N10CC58P40 

02/19/98 

00:57:49 

02/19/98 

01:00:20 

M10C58P31 

N10CC58P39 

02/19/98 

00:57:52 

02/19/98 

01:00:21 

N10C58P32 

H100C58P38 

02/19/98 

00:57:51 

02/19/98 

01:00:21 

N10C58P33 

W100C58P37 

02/19/98 

00:57:53 

02/19/98 

01:00:22 

N10C58R34 

N100C58P36 

02/19/98 

00:57:53 

02/19/98 

01:00:22 

N10C58P35 

N100C58P35 

02/19/98 

00:57:53 

02/19/98 

01:00:22 

N10C58P36 

N100C58P34 

02/19/98 

00:57:53 

02/19/98 

01:00:22 

N10C58P37 

N100C58P33 

02/19/98 

00:57:55 

02/19/98 

01:00:22 

N10C58P38 

N100C58P32 

02/19/98 

00:57:55 

02/19/98 

01:00:23 

N10C58P39 

N100C58P31 

02/19/98 

00:57:55 

02/19/98 

01:00:23 

K10C58P40 

N100C58P30 

02/19/98 

00:57:56 

02/19/98 

01:00:23 

K10C58P41 

N1Q0C58R29 

02/19/98 

00:57:56 

02/19/98 

01:00:23 

N10C58P42 

N100C58P28 

02/19/98 

00:57:56 

02/19/98 

01:00:24 

N10C58P43 

W100C58P27 

02/19/98 

00:57:58 

02/19/98 

01:00:24 

N10C58P44 

H100C58P26 

02/19/98 

00:57:58 

02/19/98 

01:00:24 

N10C58P45 

W100C58P25 

02/19/98 

00:57:58 

02/19/98 

01:00:24 

N10C58P46 

N1DQC58P24 

02/19/98 

00:57:58 

02/19/98 

01:00:24 

N10C58P24 

Nl 00C58P46 

02/19/98 

00:57:36 

02/19/98 

01:00:25 

N10C25P41 

N8C26P28 

02/19/98 

06:33:02 

02/19/98 

06:33:23 

'C25P42 

N8C26P27 

02/19/98 

06:33:03 

02/19/98 

06:33:24 

J25P43 

W8C26P26 

02/19/98 

06:33:02 

02/19/98 

06:33:24 

n10C25P44 

W8C26P25 

02/19/98 

06:33:01 

02/19/98 

06:33:24 

N10C25P45 

N8C26P24 

02/19/98 

06:33:01 

02/19/98 

06:33:24 

N1QC25P46 

N8C26P10 

02/19/98 

06:32:54 

02/19/98 

06:33:24 

N10C25P41 

N8C26P29 

02/19/98 

06:33:47 

02/19/98 

06:34:07 

N10C25P42 

N8C26P28 

02/19/98 

06:33:47 

02/19/98 

06:34:08 

Duration 
ddd:hh :mn: ss 

000:00:01:28 
000:00:01:29 
000:00:01:32 
000:03:03:17 
000:03:03; 18 
000:03:03:18 
000:03:03:19 
000:03:03:20 
000:03:03:27 
000:00:00:00 
000:00:00:00 
008:08:11:19 
000:02:37:47 
000:02:37:48 
000:02:37:49 
000:02:37:49 
000:02:37:50 
000:02:37:52 
000:00:02:31 
000:00:02:31 
000:00:02:31 
000:00:02:31 
000:00:02:31 
000:00:02:31 
000:00:02:29 
000:00:02:30 
000:00:02:29 
000:00:02:29 
000:00:02:29 
000:00:02:29 
000:00:02:27 
000:00:02:28 
000:00:02:28 
000:00:02:27 
000:00:02:27 
000:00:02:28 
000:00:02:26 
000:00:02:26 
000:00:02:26 
000:00:02:26 
000:00:02:49 
000:00:00:21 
000:00:00:21 
000:00:00:22 
000:00:00:23 
000:00:00:23 
000:00:00:30 
000:00:00:20 
000:00:00:21 


Cali.  DuratTon  Report  for  device  N1D 
Hon  Peb  23  11:59:41  1998 


Origination 

Port 

W10C25P43 

N10C25P44 

W10C25P45 

N10C25P46 

N10C25P41 

N10C25P42 

N10C25P43 

N10C25P44 

N10C25P45 

N10C25P46 

M10C25P41 

N10C25P42 

N10C25P43 

N10C25P44 

N10C25P45 

N10C25P46 

N10C58P25 

'C58P26 

JC58P27 

W10C58P28 

N10C58P29 

N10C58P30 

K10C58P31 

N10C58P32 

K10C58P33 

N1CC5SP34 

W10C58P35 

N10C58P36 

N10C58P37 

N10C58P38 

N10C58P39 

N10C58P40 

N10C58P41 

M10C58P42 

N10C58P43 

K10C58P44 

K10C58P45 

N10C58P46 

N10C5SP24 

N10C58P26 

N10C58P27 

N10C58P28 

‘•«0C58P29 

/C58P30 

*10C58P31 

K10C58P32 

N10C58P33 

W10C58P34 

N10C58P35 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Termination  Connect  Time 
Port  rrm/dd/yy  hh:mm:ss 


Disconnect  Time  Duration 
rrm/dd/yy  hh :trrn:  ss  dcJd:hh:rrm:ss 


N8C26P27 

N8C26P26 

W8C26P25 

N8C26P24 

N8C26P29 

N8C26P28 

N8C26P27 

N8C26P26 

N8C26P25 

N8C26P24 
N8C26P29 
N8C26P28 
N8C26P27 
N8C26P26 
N8C26P25 
N8C26P24 
N1QCC58P45 
N100C58P44 
N10DC55P43 
H100C58P42 
N100C58P41 
W100C5SP40 
M100C58P39 
M100C58P38 
-M100C58P37 
N100C58P36 
N100C58P35 
N100C58P34 
N100C58P33 
N100C58P32 
H100C58P31 
N 1 00C58P30 
N100C58P29 
M100C58P28 
N100C58P27 
HI OOC58P26 
N100C58P25 
N100C58P24 
M100C58P46 
N100C58P45 
N100C58P44 
N100C58P43 
N100C58P42 
K100C58P41 
M100C58P40 
N100C58P39 
N100C58P38 
N100C58P37 
N100C58P36 


02/19/98  06:33:47 
02/19/98  06:33:46 
02/19/98  06:33:46 
02/19/98  06:33:39 
02/19/93  06:37:46 
02/19/98  06:37:45 
02/19/98  06:37:44 
02/19/98  06:37:44 
02/19/98  06:37:44 
02/19/98  06:37:37 
02/19/98  06:39:28 
02/19/93  06:39:28 
02/19/98  06:39:27 
02/19/98  06:39:27 
02/19/98  06:39:27 
02/19/98  06:39:20 
02/19/98  06:59:20 
02/19/98  06:59:20 
02/19/98  06:59:21 
02/19/98  06:59:21 
02/19/98  06:59:21 
02/19/98  06:59:21 
02/19/98  06:59:22 
02/19/98  06:59:23 
02/19/98  06:59:23 
02/19/98  06:59:23 
02/19/98  06:59:23 
02/19/98  06:59:23 
02/19/98  06:59:24 
02/19/98  06:59:25 
02/19/98  06:59:26 
02/19/98  06:59:27 
02/19/98  06:59:27 
02/19/98  06:59:27 
02/19/98  06:59:28 
02/19/98  06:59:28 
02/19/98  06:59:28 
02/19/98  06:59:29 
02/19/98  06:59:06 
02/19/98  08:19:29 
02/19/98  08:19:29 
02/19/98  08:19:30 
02/19/98  08:19:30 
02/1 9/98  08:19:30 

02/19/08  08:19*30 
02/19/98  08:19:32 
02/19/98  08:19:32 
02/19/98  08:19:32 
02/19/98  08:19:33 


02/19/98  06:34:08 
02/19/98  06:34:08 
02/19/98  06:34:08 
02/19/98  06:34:08 
02/19/98  06:38:05 
02/19/98  06:38:05 
02/19/98  06:38:05 
02/19/98  06:38:05 
02/19/98  06:38:05 
02/19/98  06:38:05 
02/19/98  06:39:49 
02/19/98  06:39:49 
02/19/98  06:39:49 


000:00:00:21 

000:00:00:22 

000:00:00:22 

000:00:00:29 

000:00:00:19 

000:00:00:20 

000:00:00:21 

000:00:00:21 

000:00:00:21 

000:00:00:28 

000:00:00:21 

000:00:00:21 

.000:00:00:22 


02/19/98  06:39:49 
02/19/98  06:39:50 
02/19/98  06:39:50 
02/19/98  07:00:44 
02/19/98  07:00:44 
02/19/98  07:00:44 
02/19/98  07:00:44 
02/19/98  07:00:44 
02/19/98  07:00:44 
02/19/98  07:00:44 
02/19/98  07:00:45 
02/19/98  07:00:45 
02/19/98  07:00:45 
02/19/98  07:00:45 
02/19/98  07:00:45 
02/19/98  07:00:45 
02/19/98  07:00:46 
02/19/98  07:00:4 7 
02/19/98  07:00:48 
02/19/98  07:00:48 
02/19/98  07:00:48 
02/19/98  07:00:48 
02/19/98  07:00:48 
02/19/98  07:00:48 
02/19/98  07:00:49 
02/19/98  07:00:49 
02/19/98  08:25:23 
02/19/98  08:25:23 
02/19/98  08:25:23 
02/19/98  08:25:23 
02/19/98  08:25:23 
02/19/98  08:25:23 
02/19/98  08:25:24 
02/19/98  08:25:24 
02/19/98  08:25:24 
02/19/98  08:25:25 


000:00:00:22 
000:00:00:23 
000:00:00:30 
000:00:01:24 
000:00:01:24 
000:00:01:23 
000:00:01:23 
000:00:01:23 
000:00:01:23 
000:00:01:22 
000:00:01:22 
000:00:01:22 
000:00:01:22 
000:00:01:22 
000:00:01:22 
000:00:01:21 
000:00:01:21 
000:00:01:21 
000:00:01:21 
000:00:01:21 
000:00:01:21 
000:00:01:20 
000:00:01:20 
000:00:01:20 
000:00:01:20 
000:00:01:43 
000:00:05:54 
000:00:05:54 
000:00:05:53 
000:00:05:53 
000:00:05:53 
000:00:05 : 53 
000:00:05:52 
000:00:05:52 
000:00:05:52 
000:00:05:52 


Call  Duration  Report  for  device  N10 
Hon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:mm:ss 

mm/dd/yy  hh:mm;ss 

ddd:  hh  :mrt:ss 

N10C58P36 

N1C0C58P35 

02/19/98  03:19:33 

02/19/98  08:25:25 

000:00:05:52 

N10C58P37 

N100C58P34 

02/19/98  03:19:33 

02/19/98  08:25:25 

000:00:05:52 

W10C58P39 

N100C53P32 

02/19/98  08:19:34 

02/19/98  08:25:25 

000:00:05:51 

N 10C58P40 

N 1 00C58P3 1 

02/19/98  08:19:36 

02/19/98  08:25:26 

000:00:05:50 

N10C58P38 

N100C58P33 

02/19/98  08:19:34 

02/19/98  08:25:26 

000:00:05:52 

W10C58P41 

KI100C58P30 

02/19/98  08:19:35 

02/19/98  08:25:26 

000:00:05:51 

N1QC58P42 

N100C58P29 

02/19/98  08:19:36 

02/19/98  08:25:27 

000:00:05:51 

N'10C58P43 

N100C58P28 

02/19/98  08:19:36 

02/19/98  08:25:27 

000:00:05:51 

N1QC58P44 

N100C58P27 

02/19/98  08:19:37 

02/19/98  08:25:27 

000:00:05:50 

N10C58P45 

N100C58P26 

02/19/98  08:19:38 

02/19/98  08:25:28 

000:00:05:50 

N10C58P46 

N100C58P25 

02/19/98  08:19:38 

02/19/98  08:25:28 

000:00:05:50 

N10C58P25 

N100C58P46 

02/19/98  08:19:16 

02/19/98  08:25:28 

000:00:06:12 

N10C39P8 

N12C10P0 

01/04/98  01:34:46 

02/19/98  08:40:58 

046:07:06:12 

N10C25P39 

N8C25P9 

02/19/95  09:16:19 

02/19/98  09:17:53 

000:00:01:34 

N10C25P40 

N8C25P7 

02/19/98  09:16:07 

02/19/98  09:17:53 

000:00:01:46 

N10C25P35 

N8C25P13 

02/19/98  09:19:07 

02/19/98  09:20:37 

000:00:01:30 

N10C25P36 

N8C25P12 

02/19/98  09:19:07 

02/19/98  09:20:38 

000:00:01:31 

1C25P37 

N8C25P1 1 

02/19/98  09:19:07 

02/19/98  09:20:38 

000:00:01:31 

0C25P38 

N8C25P10 

02/19/98  09:19:06 

02/19/98  09:20:38 

000:00:01:32 

M10C25P39 

M8C25P9 

02/19/98  09:19:07 

02/19/98  09:20:39 

000:00:01:32 

N10C25P40 

M8C25P7 

02/19/98  09:19:02 

02/19/98  09:20:39 

000:00:01:37 

N10C26P18 

N8C25P30 

02/19/98  09:22:08 

02/19/98  09:22:11 

000:00:00:03 

M10C26P17 

N8C25P31 

02/19/98  09:22:09 

02/19/98  09:22:12 

000:00:00:03 

N10C26P16 

N8C25P30 

02/19/98  09:22:13 

02/19/98  09:22:13 

000:00:00:00 

W10C26P19 

W8C25P29 

02/19/98  09:22:08 

02/19/98  09:22:13 

000:00:00:05 

N10C26P20 

N8C25P23 

02/19/98  09:22:07 

02/19/98  09:22:13 

000:00:00:06 

N10C26P21 

N3C25P27 

02/19/98  09:22:07 

02/19/98  09:22:13 

000:00:00:06 

N10C26P22 

K8C25P26 

02/19/98  09:22:07 

02/19/98  09:22:14 

000:00:00:07 

N10C25P24 

N8C25P25 

02/19/98  09:22:07 

02/19/98  09:22:14 

000:00:00:07 

N10C25P25 

N8C25P24 

02/19/98  09:22:06 

02/19/98  09:22:14 

000:00:00:08 

N1QC25P26 

N8C25P22 

02/19/98  09:22:06 

02/19/98  09:22:15 

000:00:00:09 

N10C25P27 

N8C25P21 

02/19/98  09:22:06 

02/19/98  09:22:15 

000:00:00:09 

N10C25P28 

N8C25P20 

02/19/98  09:22:05 

02/19/98  09:22:15 

000:00:00:10 

N10C25P29 

N8C25P19 

02/19/98  09:22:05 

02/19/98  09:22:16 

000:00:00:11 

N10C25P30 

N8C25P18 

02/19/98  09:22:05 

02/19/98  09:22:16 

000:00:00:11 

N10C25P31 

N8C25P17 

02/19/98  09:22:04 

02/19/98  09:22:16 

000:00:00:12 

N10C25P32 

N8C25P16 

02/19/98  09:22:05 

02/ 19/98  09:22:17 

000:00:00:12 

N10C25P33 

N6C25P15 

02/19/98  09:22:04 

02/19/98  09:22:17 

000:00:00:13 

N10C25P34 

N8C25P14 

02/19/98  09:22:04 

02/19/98  09:22:17 

000:00:00:13 

N10C25P35 

N8C25P13 

02/19/98  09:22:03 

02/19/98  09:22:17 

000:00:00:14 

N10C25P36 

N8C25P12 

02/19/98  09:22:03 

02/19/98  09:22:18 

000:00:00:15 

N10C25P37 

N8C25P1 1 

02/19/98  09:22:03 

02/19/98  09:22:18 

000:00:00:15 

’0C25P38 

N8C25P10 

02/19/98  09:22:02 

02/19/98  09:22:18 

000:00:00:16 

JC2SP39 

W8C25P9 

02/19/98  09:22:02 

02/19/98  09:22:19 

000:00:00:17 

N10C25P40 

N8C25P7 

02/19/98  09:21:57 

02/19/98  09:22:19 

0Q0;QQ;GQ;22 

N10C25P29 

N8C25P19 

02/19/98  09:22:52 

02/19/98  09:23:24 

000:00:00:32 

N10C25P30 

N8C25P18 

02/19/98  09:22:52 

02/19/98  09:23:24 

000:00:00:32 

N10C25P31 

N8C25P17 

02/19/98  09:22:52 

02/19/98  09:23:25 

000:00:00:33 

H10C25P32 

N8C25P16 

02/19/98  09:22:51 

02/19/98  09:23:25 

000:00:00:34 

Cali  Duration  Report  for  device  N10 
Mon  Feb  23  11:59:41  1998 

From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:nm:ss 

rm/dd/yy 

hh:mm:ss 

ddd:hh:rrm:ss 

N1QC25P33 

N8C25P15 

02/19/98  09:22:51 

02/19/98 

09:23:25 

000:00:00:34 

N10C25P34 

N8C25P14 

02/19/98  09:22:51 

02/19/98 

09:23:26 

000:00:00:35 

N10C25P35 

M8C25P13 

02/19/98  09:22:51 

02/19/98 

09:23:26 

000:00:00:35 

N10C25P36 

N8C25P12 

02/19/98  09:22:50 

02/19/98 

09:23:26 

000:00:00:36 

W10C25P37 

N8C25P1 1 

02/19/98  09:22:50 

02/19/98 

09:23:27 

000:00:00:37 

H10C25P38 

NSC25P1G 

02/19/95  09:22:50 

02/19/98 

09:23:27 

000:00:00:37 

N10C25P39 

N8C25P9 

02/19/98  09:22:49 

02/19/98 

09:23:27 

000:00:00:38 

N10C25P40 

N8C25P7 

02/19/98  09:22:44 

02/19/98 

09:23:27 

000:00:00:43 

N10C25P35 

N8C25P13 

02/19/98  09:27:59 

02/19/98 

09:34:47 

000:00:06:48 

N10C25P36 

N8C25P12 

02/19/98  09:27:58 

02/19/98 

09:34:47 

000:00:06:49 

N10C25P37 

N8C25P11 

02/19/98  09:27:58 

02/19/98 

09:34:47 

000:00:06:49 

N10C25P38 

N8C25P10 

02/19/98  09:27:58 

02/19/98 

09:34:48 

000:00:06:50 

N10C25P39 

N8C25P9 

02/19/98  09:27:57 

02/19/98 

09:34:48 

000:00:06:51 

N10C25P40 

N8C25P7 

02/19/98  09:27:53 

02/19/98 

09:34:48 

000:00:06:55 

N10C27P7 

N1QC43P0 

09/16/97  12:55:46 

02/19/98 

09:49:05 

155:21:53:19 

N10C43P1 

N11C43P1 

01/27/98  09:23:43 

02/19/98 

09:49:05 

023:00:25:22 

U10C43P2 

N70C43P1 

12/17/97  15:58:56 

02/19/98 

09:49:05 

063:17:50:09 

C43P3 

N20C27P0 

12/17/97  15:58:56 

02/19/98 

09:49:05 

063:17:50:09 

0C43P4 

N80C22PG 

02/02/98  14:47:45 

02/19/98 

09:49:05 

016:19:01:20 

N10C43P7 

N10C59PO 

09/16/97  12:55:16 

02/19/98 

09:49:05 

155:21:53:49 

N10C58P47 

M10C43P5 

02/18/98  16:11:44 

02/19/98 

09:49:05 

000:17:37:21 

N10C58P25 

N100C58P27 

02/19/98  12:34:44 

02/19/98 

12:35:33 

000:00:00:49 

H10C58P26 

N100C58P26 

02/19/98  12:34:44 

02/19/98 

12:35:33 

000:00:00:49 

N10C58P27 

N100C58P25 

02/19/98  12:34:44 

02/19/98 

12:35:33 

000:00:00:49 

N10C58P28 

N100C58P24 

02/19/98  12:34:44 

02/19/98 

12:35:33 

000:00:00:49 

W10C58P24 

N100C58P28 

02/19/98  12:34:34 

02/19/98 

12:35:33 

000:00:00:59 

N10C58P25 

N100C58P45 

02/19/98  12:38:45 

02/19/98 

12:56:04 

000:00:17:19 

N10C58P26 

N100C58P44 

02/19/98  12:38:45 

02/19/98 

12:56:04 

000:00:17:19 

N10C58P27 

Nl QQC58P43 

02/19/98  12:38:45 

02/19/98 

12:56:04 

000:00:17:19 

N10C58P28 

Ml OOC58P42 

02/19/98  12:38:45 

02/19/98 

12:56:04 

000:00:17:19 

N10C58P29 

N100C58P41 

02/19/98  12:38:45 

02/19/98 

12:56:04 

000:00:17:19 

H10C58P30 

N100C58P40 

02/19/98  12:38:45 

02/19/98 

12:56:04 

000:00:17:19 

N10C58P31 

N100C58P39 

02/19/98  12:38:47 

02/19/98 

12:56:05 

000:00:17:18 

N10C58P32 

M100C58P38 

02/19/98  12:38:47 

02/19/98 

12:56:05 

000:00:17:18 

M10C58P33 

M100C58P37 

02/19/98  12:38:48 

02/19/98 

12:56:05 

000:00:17:17 

N10C58P34 

N100C58P36 

02/19/98  12:38:49 

02/19/98 

12:56:06 

000:00:17:17 

N10C58P35 

H100C58P35 

02/19/98  12:38:49 

02/19/98 

12:56:06 

000:00:17:17 

N10C58P36 

N100C58P34 

02/19/98  12:38:49 

02/19/98 

12:56:06 

000:00:17:17 

N10C58P37 

N1Q0C58P33 

02/19/96  12:38:50 

02/19/98 

12:56:06 

000:00:17:16 

N10C58P38 

N100C58P32 

02/19/98  12:38:50 

02/19/98 

12:56:06 

000:00:17:16 

K 1 0C58P39 

N100C58P31 

02/19/98  12:35:51 

02/19/98 

12:56:07 

000:00:17:16 

N10C58P40 

N100C58P30 

02/19/98  12:38:51 

02/19/98 

12:56:07 

000:00:17:16 

^C58P41 

N100C58P29 

02/19/98  12:38:52 

02/19/98 

12:56:07 

000:00:17:15 

DC58P42 

N100C58P28 

02/19/98  12:38:52 

02/19/98 

12;56;Q6 

000:00:17: 16 

N10C58P43 

M10QC58P27 

02/19/98  12:38:52 

02/19/98 

12:56:08 

000:00:17:16 

N10C58P44 

N100C58P26 

02/19/98  12:38:53 

02/19/98 

12:56:08 

000:00:17:15 

N10C58P45 

N100C58P25 

02/19/98  12:38:53 

02/19/98 

12:56:08 

000:00:17:15 

N10C58P46 

N1Q0C58P24 

02/19/98  12:38:54 

02/19/98 

12:56:09 

000:00:17:15 

N10C58P24 

Nl 00C58P46 

02/19/98  12:38:31 

02/19/98 

12:56:09 

000:00:17:38 

Call  Duration  Report  for  device  Ml 0 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  ' 

rime 

Disconnect  Time 

Port 

Port 

mm/dd/yy 

hh:rm:ss 

mm/dd/yy 

hh:mm:$s 

N10C58P25 

N10CC58P45 

02/19/98 

14:06:53 

02/19/98 

14:08:01 

N10C58P26 

W100C58P44 

02/19/98 

14:06:53 

02/19/98 

14:08:02 

N10C58P27 

N100C58P43 

02/19/93 

14:06:54 

02/19/98 

14:08:02 

N10C58P28 

N100C58P42 

02/19/98 

14:06:54 

02/19/98 

14:08:02 

N10C55P29 

N10GC58P41 

02/19/98 

14:06:54 

02/ 19/98 

14:08:02 

N10C58P30 

N100C58P40 

02/19/98 

14:06:54 

02/19/98 

14:08:02 

N10C58P31 

N100C58P39 

02/19/98 

14:06:55 

02/19/98 

14:08:02 

N10C58P32 

N100C58P38 

02/19/98 

14:06:56 

02/19/98 

14:08:03 

N1QC58P33 

N100C58P37 

02/19/98 

14:06:56 

02/19/98 

14:08:05 

N1QC58P34 

N100C58P36 

02/19/98 

14:06:56 

02/19/98 

14:08:05 

N10C58P36 

N100C58P34 

02/19/98 

14:06:57 

02/19/98 

14:08:06 

N10C58P37 

N100C58P33 

02/19/98 

14:06:58 

02/19/98 

14:08:06 

N10C58P35 

N100C58P35 

02/19/98 

14:06:56 

02/19/98 

14:08:06 

K10C58P38 

N100C58P32 

02/19/98 

14:06:59 

02/19/98 

14:08:07 

N10C58P39 

N100C58P31 

02/19/98 

14:06:59 

02/19/98 

14:08:07 

N10C58P40 

W100C58P30 

02/19/98 

14:06:59 

02/19/98 

14:08:07 

N10C58P41 

N100C58P29 

02/19/98 

14:06:59 

02/19/98 

14:08:07 

:58P42 

M100C58P28 

02/19/98 

14:06:59 

02/19/98 

14:08:07 

JC58P43 

N100C58P27 

02/19/98 

14:07:01 

02/19/98 

14:08:08 

N10C58P44 

N100C58P26 

02/19/98 

14:07:02 

02/19/98 

14:08:08 

N10C58P45 

N100C58P25 

02/19/98 

14:07:02 

02/19/98 

14:08:08 

N10C58P46 

N100C58P24 

02/19/98 

14:07:02 

02/19/98 

14:08:09 

N10C58P24 

N10CC58P46 

02/19/98 

14:06:40 

02/19/98 

14:08:09 

K10C58P26 

N100C58P45 

02/19/98 

14:25:54 

02/19/98 

14:28:30 

N10C58P27 

U100C58P44 

02/19/98 

14:25:54 

02/19/98 

14:28:30 

N1QC58P28 

N100C58P43 

02/19/98 

14:25:54 

02/19/98 

14:28:30 

K10C58P29 

W100C58P42 

02/19/98 

14:25:54 

02/19/98 

14:28:30 

N10C58P30 

N1Q0C5SP41 

02/19/98 

14:25:54 

02/19/98 

14:28:30 

N10C58P31 

N100C58P40 

02/19/98 

14:25:54 

02/19/98 

14:28:30 

M10C58P32 

N100C58P39 

02/19/98 

14:25:56 

02/19/98 

14:28:31 

N1QC58P33 

N100C58P38 

02/19/98 

14:25:57 

02/19/98 

14:28:31 

K10C58P34 

W100C58P37 

02/19/98 

14:25:57 

02/19/98 

14:28:31 

N10C58P25 

N100C58P46 

02/19/98 

14:25:40 

02/19/98 

14:28:32 

N10C58P35 

N100C58P36 

02/19/98 

14:25:57 

02/19/98 

14:28:32 

W10C58P36 

N100C58P35 

02/19/98 

14:25:58 

02/19/98 

14:28:32 

N10C58P37 

N100C58P34 

02/19/98 

14:25:58 

02/19/98 

14:28:32 

N10C58P38 

N100C58P33 

02/19/98 

14:25:59 

02/19/98 

14:28:32 

N10C58P39 

N100C58P32 

02/19/98 

14:26:00 

02/19/98 

14:28:32 

N10C58P40 

N100C58P31 

02/19/98 

14:26:00 

02/19/98 

14:28:32 

N10C58P41 

N100C58P3Q 

02/19/98 

14:26:00 

02/19/98 

14:28:32 

N10C58P42 

N100C58P29 

02/19/98 

14:26:00 

02/19/98 

14:28:32 

N10C58P43 

M100C58P28 

02/19/98 

14:26:01 

02/19/98 

14:28:32 

C58P44 

N100C58P27 

02/19/98 

14:26:02 

02/19/98 

14:28:32 

.C58P45 

W100C58P26 

02/19/98 

14:26:02 

02/19/98 

14:28:32 

N10C58P46 

N100C56P25 

02/19/90 

14:20:03 

02/19/90 

14;20:32 

N10C2SP41 

HSC26PB 

02/19/98 

06:51:49 

02/19/98 

16:04:19 

N10C25P42 

N8C26P7 

02/19/98 

06:51:49 

02/19/98 

16:04:19 

N10C25P43 

N8C26P6 

02/19/98 

06:51:49 

02/19/98 

16:04:20 

N10C25P44 

N8C26P4 

02/19/98 

06:51:49 

02/19/98 

16:04:20 

Duration 

ddd:hh:mm:ss 

000:00:01:08 

000:00:01:09 

000:00:01:08 

000:00:01:08 

000:00:01:08 

000:00:01:08 

000:00:01:07 

000:00:01:07 

000:00:01:09 

000:00:01:09 

000:00:01:09 

000:00:01:08 

000:00:01:10 

000:00:01:08 

000:00:01:08 

000:00:01:08 

000:00:01:08 

000:00:01:08 

000:00:01:07 

000:00:01:06 

000:00:01:06 

000:00:01:07 

000:00:01:29 

000:00:02:36 

000:00:02:36 

000:00:02:36 

000:00:02:36 

000:00:02:36 

000:00:02:36 

000:00:02:35 

000:00:02:34 

000:00:02:34 

000:00:02:52 

000:00:02:35 

000:00:02:34 

000:00:02:34 

000:00:02:33 

000:00:02:32 

000:00:02:32 

000:00:02:32 

000:00:02:32 

000:00:02:31 

000:00:02:30 

000:00:02:30 

000:00:02:29 

000:09:12:30 

000:09:12:30 

000:09:12:31 

000:09:12:31 


Call  Duration  Report  for  device  N1Q 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Port 

Port 

mm/dd/yy 

bh:mm:ss 

rrcn/dd/yy 

hh:rifn:ss 

N10C25P45 

N8C26P2 

02/19/98 

06:51:48 

02/19/98 

16:04:20 

N10C25P46 

N8C26P30 

02/19/98 

06:51:41 

02/19/98 

16:04:20 

N10C58P26 

N100C58P45 

02/19/98 

17:17:1 7 

02/19/98 

17:19:33 

N10C58P27 

M100C58P44 

02/19/98 

17:17:17 

02/19/98 

17:19:33 

N10C58P28 

N10CC58P43 

02/19/98 

17:17:17 

02/19/98 

17:19:33 

M10C58P29 

N 100C58P42 

02/19/98 

17:17:17 

02/19/98 

17:19:33 

N10C58P30 

N100C58P41 

02/19/98 

17:17:17 

02/19/98 

17:19:33 

N10C5SP31 

N100C58P40 

02/19/98 

17:17:17 

02/19/98 

17:19:33 

M10C58P32 

M100C58P39 

02/19/98 

17:17:19 

02/19/98 

17:19:33 

N10C58P33 

N100C58P38 

02/19/98 

17:17:19 

02/19/98 

17:19:33 

N10C58P34 

N100C58P37 

02/19/98 

17:17:19 

02/19/98 

17:19:33 

N10C58P35 

N100C58P36 

02/19/98 

17:17:20 

02/19/98 

17:19:34 

M10C58P36 

N100C58P35 

02/19/98 

17:17:20 

02/19/98 

17:19:34 

N10C58P25 

N100C58P46 

02/19/98 

17:17:02 

02/19/98 

17:19:34 

N10C58P37 

N100C58P34 

02/19/98 

17:17:20 

02/19/98 

17:19:34 

N10C58P38 

N100C58P33 

02/19/98 

17:17:22 

02/19/98 

17:19:34 

N10C58P39 

N100C58P32 

02/19/98 

17:17:22 

02/19/98 

17:19:34 

:58P40 

N100C58P31 

02/19/98 

17:17:22 

02/19/98 

17:19:34 

JC58P41 

N100C58P30 

02/19/98 

17:17:23 

02/19/98 

17:19:34 

M10C58P42 

N100C58P29 

02/19/98 

17:17:23 

02/19/98 

17:19:34 

N10C58P43 

N100C58P28 

02/19/98 

17:17:23 

02/19/98 

17:19:34 

N1QC58P44 

N100C58P27 

02/19/98 

17:17:24 

02/19/98 

17:19:34 

N10C58P45 

W100C58P26 

02/19/98 

17:17:25 

02/19/98 

17:19:34 

N10C58P46 

M100C58P25 

02/19/98 

17:17:25 

02/19/98 

17:19:34 

N10C58P26 

N100C58P45 

02/20/98 

07:41:34 

02/20/98 

07:42:33 

N10C58P27 

N100C58P44 

02/20/98 

07:41:34 

02/20/98 

07:42:33 

N10C58P28 

N100C58P43 

02/20/98 

07:41:34 

02/20/98 

07:42:33 

H10C58P29 

N100C58P42 

02/20/98 

07:41:34 

02/20/98 

07:42:33 

N10C58P30 

N100C58P41 

02/20/98 

07:41:34 

02/20/98 

07:42:33 

W10C58P31 

N100C58P40 

02/20/98 

07:41:35 

02/20/98 

07:42:35 

N10C58P32 

N100C58P39 

02/20/98 

07:41:37 

02/20/98 

07:42:35 

N10C58P34 

M100C58P37 

02/20/98 

07:41:37 

02/20/98 

07:42:35 

N10C58P33 

N100C58P38 

02/20/98 

07:41:37 

02/20/98 

07:42:35 

N10C58P35 

N100C58P36 

02/20/98 

07:41:38 

02/20/98 

07:42:35 

K1QC58P36 

N100C58P35 

02/20/98 

07:41:38 

02/20/98 

07:42:35 

N1QC58P37 

N100C5SP34 

02/20/98 

07:41:38 

02/20/98 

07:42:36 

M10C58P38 

N100C58P33 

02/20/98 

07:41:39 

02/20/98 

07:42:36 

N10C58P39 

N100C58P32 

02/20/98 

07:41:40 

02/20/98 

07:42:37 

N10C58P40 

N100C58P31 

02/20/98 

07:41:40 

02/20/98 

07:42:37 

N10C58P41 

N100C58P30 

02/20/98 

07:41:41 

02/20/98 

07:42:37 

N10C58P42 

N10QC58P29 

02/20/98 

07:41:41 

02/20/98 

07:42:37 

M10C58P43 

N100C58P28 

02/20/98 

07:41:41 

02/20/98 

07:42:37 

‘C58P44 

N100C58P27 

02/20/98 

07:41:42 

02/20/98 

07:42:37 

C58P45 

W100C58P26 

02/20/98 

07:41:42 

02/20/98 

07:42:37 

N1GC56P46 

N100C58P25 

02/20/96 

07:41:43 

02/20/96 

07;42;38 

N10C58P25 

N100C58P46 

02/20/98 

07:41:21 

02/20/98 

07:42:38 

N10C58P26 

N100C58P45 

02/20/98 

07:43:55 

02/20/98 

07:46:30 

N10C58P27 

N100C58P44 

02/20/98 

07:43:56 

02/20/98 

07:46:31 

N10C58P28 

M100C58P43 

02/20/98 

07:43:57 

02/20/98 

07:46:31 

Duration 

ddd:hh:nm:ss 

000:09:12:32 
000:09:12:39 
000;00;02; 16 
000:00:02:16 
000:00:02:16 
000:00:02:16 
000:00:02:16 
000:00:02:16 
000:00:02:14 
000:00:02:14 
000:00:02:14 
000:00:02:14 
000:00:02:14 
000:00:02:32 
000:00:02:14 
000:00:02:12 
000:00:02:12 
000:00:02:12 
000:00:02:11 
000:00:02:11 
000:00:02:11 
000:00:02:10 
000:00:02:09 
000:00:02:09 
000:00:00:59 
000:00:00:59 
000:00:00:59 
000:00:00:59 
000:00:00:59 
000:00:01:00 
000:00:00:53 
000:00:00:58 
000:00:00:58 
000:00:00:57 
000:00:00:57 
000:00:00:58 
000:00:00:57 
000:00:00:57 
000:00:00:57 
000:00:00:56 
000:00:00:56 
000:00:00:56 
000:00:00:55 
000:00:00:55 
000:00:00:55 
000:00:01:17 
000:00:02:35 
000:00:02:35 
000:00:02:34 


Call  Duration  Report  for  device  N 1 0 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:mm:ss 

rm/dd/yy  hh:mm:ss 

ddd:hh:rmn:ss 

M10C58P29 

N100C58P42 

02/20/98  07:43:57 

02/20/98  07:46:31 

000:00:02:34 

HM0C58P3Q 

N100C58P41 

02/20/98  07:43:57 

02/20/98  07:46:31 

000:00:02:34 

N1QC58P31 

N100C58P40 

02/20/98  07:43:57 

02/20/98  07:46:31 

000:00:02:34 

M10C58P32 

N100C58P39 

02/20/98  07:43:59 

02/20/98  07:46:31 

000:00:02:32 

K10C58P33 

N100C58P38 

02/20/98  07:43:59 

02/20/98  07:46:31 

000:00:02:32 

N10C58P34 

N100C58P37 

02/20/98  07:43:59 

02/20/98  07:46:31 

000:00:02:32 

N10C5SP35 

N100C58P36 

02/20/98  07:43:59 

02/20/98  07:46:31 

000:00:02:32 

K10C58P36 

N100C58P35 

02/20/98  07:44:00 

02/20/98  07:46:32 

000:00:02:32 

W10C58P37 

W100C58P34 

02/20/98  07:44:00 

02/20/98  07:46:32 

000:00:02:32 

N10C58P38 

N100C58P33 

02/20/98  07:44:02 

02/20/98  07:46:33 

000:00:02:31 

N10C5SP39 

N100C58P32 

02/20/98  07:44:02 

02/20/98  07:46:33 

000:00:02:31 

N10C58P40 

N 1 00C5SP3 1 

02/20/98  07:44:02 

02/20/98  07:46:33 

000:00:02:31 

N1QC58P41 

N10QC58P3G 

02/20/98  07:44:02 

02/20/98  07:46:33 

000:00:02:31 

N10C58P42 

N100C58P29 

02/20/98  07:44:03 

02/20/98  07:46:34 

000:00:02:31 

N1QC58P43 

N100C58P28 

02/20/98  07:44:03 

02/20/98  07:46:34 

000:00:02:31 

M10C58P44 

N10QC58P27 

02/20/98  07:44:04 

02/20/98  07:46:34 

000:00:02:30 

K10C58P45 

N100C58P26 

02/20/98  07:44:05 

02/20/98  07:46:34 

000:00:02:29 

C58P46 

N100C58P25 

02/20/98  07:44:05 

02/20/98  07:46:34 

000:00:02:29 

JC58P25 

N100C58P46 

02/20/98  07:43:42 

02/20/98  07:46:35 

000:00:02:53 

K10C58P26 

N100C58P45 

02/20/98  08:50:14 

02/20/98  08:51:58 

000:00:01:44 

N10C58P27 

M100C58P44 

02/20/98  08:50:14 

02/20/98  08:51:58 

000:00:01:44 

N1QC55P28 

N1CQC56P43 

02/20/98  08:50:14 

02/20/98  08:51:58 

000:00:01:44 

N10C58P29 

N100C58P42 

02/20/98  08:50:14 

02/20/98  08:51:5 8 

000:00:01:44 

N10C58P30 

N100C58P41 

02/20/98  08:50:14 

02/20/98  08:51:58 

000:00:01:44 

N10C58P31 

' N1 0QC58P4Q 

02/20/98  08:50:14 

02/20/98  08:51:58 

000:00:01:44 

M10C58P32 

N100C58P39 

02/20/98  08:50:16 

02/20/98  08:51:59 

000:00:01:43 

N10C58P33 

N100C58P38 

02/20/98  08:50:17 

02/20/98  06:51:59 

000:00:01:42 

M10C58P34 

N100C58P37 

02/20/98  08:50:16 

02/20/98  08:51:59 

000:00:01:43 

N10C58P35 

M100C58P36 

02/20/98  08:50:17 

02/20/98  08:51:59 

000:00:01:42 

N10C58P36 

N100C58P35 

02/20/98  08:50:17 

02/20/98  08:51:59 

000:00:01:42 

N10C5SP37 

N1D0C58P34 

02/20/98  08:50:17 

02/20/98  08:51:59 

000:00:01:42 

N10C58P38 

N100C58P33 

02/20/98  08:50:18 

02/20/98  08:51:59 

000:00:01:41 

N10C58P39 

M100C58P32 

02/20/98  08:50:19 

02/20/98  08:52:00 

000:00:01:41 

N1 0C58P40 

N100C58P31 

02/20/98  08:50:19 

02/20/98  08:52:00 

000:00:01:41 

M10C58P41 

N100C58P30 

02/20/98  08:50:19 

02/20/98  08:52:00 

000:00:01:41 

N10C58P42 

N100C5BP29 

02/20/98  08:50:20 

02/20/98  08:52:00 

000:00:01:40 

N10C58P43 

W100C58P28 

02/20/98  08:50:20 

02/20/98  08:52:00 

000:00:01:40 

N10C58P44 

N100C58P27 

02/20/98  08:50:21 

02/20/98  08:52:01 

000:00:01:40 

N10C58P45 

N100C58P26 

02/20/98  08:50:22 

02/20/98  08:52:01 

000:00:01:39 

N1QC58P46 

141 00C58P25 

02/20/98  08:50:22 

02/20/98  08:52:01 

000:00:01:39 

N10C58P25 

N100C58P46 

02/20/98  08:49:59 

02/20/98  08:52:01 

000:00:02:02 

M10C58P26 

N100C58P45 

02/20/98  09:04:56 

02/20/98  09:07:09 

000:00:02:13 

''C58P27 

N100C58P44 

02/20/98  09:04:56 

02/20/98  09:07:09 

000:00:02:13 

JC58P28 

W100C58P43 

02/20/98  09:04:56 

02/20/98  09:07:09 

000:00:02:13 

N1GC58P29 

N100C58P42 

02/20/98  09:04:56 

02/20/96  09:07:09 

000:00:02:13 

N10C58P30 

N100C58P41 

02/20/98  09:04:56 

02/20/98  09:07:09 

000:00:02:13 

N10C58P31 

N100C58P40 

02/20/98  09:04:56 

02/20/98  09:07:09 

000:00:02:13 

N10058P32 

N100C58P39 

02/20/98  09:04:58 

02/20/98  09:07:10 

000:00:02:12 

N10C58P33 

N100C58P38 

02/20/98  09:04:58 

02/20/98  09:07:10 

000:00:02:12 

Call  Duration  Report  tor  device  M10 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:mm:ss 

mm/dd/yy  hh:rnn:$s 

ddd:hh:niTJ:ss 

N10C58P34 

N10GC58P37 

02/20/98  09:04:59 

02/20/98  09:07:10 

000:00:02:11 

N10C58P25 

N10GC58P46 

02/20/98  09:04:42 

02/20/98  09:07:11 

000:00:02:29 

N1QC58P35 

N100C58P36 

02/20/93  09:04:59 

02/20/98  09:07:11 

000:00:02:12 

N10C58P36 

M100C58P35 

02/20/98  09:04:59 

02/20/98  09:07:11 

000:00:02:12 

N10C58P37 

N100C58P34 

02/20/98  09:05:00 

02/20/98  09:07:11 

000:00:02:11 

N10C58P38 

N10GC58P33 

02/20/98  09:05:01 

02/20/98  09:07:11 

000:00:02:10 

M10C58P39 

N100C58P32 

02/20/98  09:05:01 

02/20/98  09:07:11 

000:00:02:10 

N10C58P40 

N100C58P3T 

02/20/98  09:05:01 

02/20/98  09:07:11 

000:00:02:10 

N10C58P41 

N100C58P30 

02/20/98  09:05:02 

02/20/98  09:07:11 

000:00:02:09 

N1QC58P42 

N100C58P29 

02/20/98  09:05:02 

02/20/98  09:07:11 

000:00:02:09 

N10C58P43 

N100C58P28 

02/20/98  09:05:03 

02/20/98  09:07:11 

000:00:02:03 

N10C58P44 

N100C58P27 

02/20/98  09:05:03 

02/20/98  09:07:11 

000:00:02:08 

N10C58P45 

N1G0C58P26 

02/20/98  09:05:04 

02/20/98  09:07:11 

000:00:02:07 

N10C58P46 

W100C53P25 

02/20/98  09:05:04 

02/20/98  09:07:11 

000:00:02:07 

N10C58P26 

N1Q0C58P45 

02/20/98  09:25:01 

02/20/98  09:34:26 

000:00:09:25 

N10C58P27 

N100C58P44 

02/20/98  09:25:02 

02/20/98  09:34:27 

000:00:09:25 

W10C58P28 

N100C58P43 

02/20/98  09:25:02 

02/20/98  09:34:27 

000:00:09:25 

JC58P29 

N100C58P42 

02/20/98  09:25:02 

02/20/98  09:34:27 

000:00:09:25 

■0C58P30 

N 1 00C58P4 1 

02/20/98  09:25:02 

02/20/98  09:34:27 

000:00:09:25 

N10C58P31 

N100C58P40 

02/20/98  09:25:02 

02/20/98  09:34:27 

000:00:09:25 

N10C58P32 

N100C58P39 

02/20/98  09:25:04 

02/20/98  09:34:27 

000:00:09:23 

N10C58P33 

N100C58P38 

02/20/98  09:25:04 

02/20/98  09:34:27 

000:00:09:23 

N10C58P34 

N100C58P37 

02/20/98  09:25:04 

02/20/98  09:34:27 

000:00:09:23 

N10C58P35 

N100C58P36 

02/20/98  09:25:05 

02/20/98  09:34:27 

000:00:09:22 

N10C58P36 

N100C58P35 

02/20/98  09:25:06 

02/20/98  09:34:28 

000:00:09:22 

N10C58P37 

M100C58P34 

02/20/98  09:25:05 

02/20/98  09:34:28 

000:00:09:23 

N10C58P38 

N100C5SP33 

02/20/98  09:25:06 

02/20/98  09:34:28 

000:00:09:22 

M10C58P39 

N100C58P32 

02/20/98  09:25:08 

02/20/98  09:34:29 

000:00:09:21 

N10C58P40 

N100C58P31 

02/20/98  09:25:07 

02/20/98  09:34:29 

000:00:09:22 

N10C58P41 

N100C58P30 

02/20/98  09:25:08 

02/20/98  09:34:29 

000:00:09:21 

N10C58P42 

N100C58P29 

02/20/98  09:25:09 

02/20/98  09:34:30 

000:00:09:21 

N10C58P43 

N1Q0C58P28 

02/20/98  09:25:09 

02/20/98  09:34:30 

000:00:09:21 

M10C58P44 

N100C58P27 

02/20/98  09;25:10 

02/20/98  09:34:31 

000:00:09:21 

N1QC5SP45 

N10QC58P26 

02/20/98  09:25:10 

02/20/98  09:34:31 

000:00:09:21 

W10C58P46 

W100C58P25 

02/20/98  09:25:10 

02/20/98  09:34:31 

000:00:09:21 

N1QC58P25 

N100C58P46 

02/20/98  09:24:48 

02/20/98  09:34:31 

000:00:09:43 

N10C58P26 

M1D0C58P45 

02/20/98  09:43:33 

02/20/98  09:45:21 

000:00:01:48 

N10C58P27 

N1QGC58P44 

02/20/98  09:43:33 

02/20/98  09:45:21 

000:00:01:48 

N10C58P28 

N1 OOC58P43 

02/20/98  09:43:33 

02/20/98  09:45:21 

000:00:01:48 

M10C58P29 

H 1 00C58P42 

02/20/98  09:43:33 

02/20/98  09:45:21 

000:00:01:48 

N10C58P30 

N100C58P41 

02/20/98  09:43:33 

02/20/98  09:45:21 

000:00:01:48 

M10C58P31 

M100C58P40 

02/20/98  09:43:33 

02/20/98  09:45:22 

000:00:01:49 

0C58P32 

N100C58P39 

02/20/98  09:43:35 

02/20/98  09:45:22 

000:00:01:47 

0CS8P33 

N10QC58P38 

02/20/98  09:43:36 

02/20/98  09:45:22 

000:00:01:46 

N1QC5BF54 

N100C5BP37 

02/20/96  09:43:37 

02/20/98  09:45:24 

000:00:01:47 

N10C58P35 

N100C58P36 

02/20/98  09:43:37 

02/20/98  09:45:24 

000:00:01:47 

N10C58P36 

N100C58P35 

02/20/98  09:43:37 

02/20/98  09:45:24 

000:00:01:47 

N10C58P37 

N100C58P34 

02/20/98  09:43:37 

02/20/98  09:45:24 

000:00:01:47 

M10C58P38 

Ml D0C58P33 

02/20/98  09:43:38 

02/20/98  09:45:24 

000:00:01:46 

Call  Duration  Repcrt  for  device  NtO 
Won  Feb  23  11*59*61  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termi nation 

Connect  Time 

Disconnect  Time 

Port 

Port 

mm/dd/yy  hhimmrss 

mm/dd/yy 

hh :  nrm:  ss 

N10C58P39 

N100C58P32 

02/20/98  09:43:39 

02/20/98 

09:45:24 

N10C58P40 

N100C58P31 

02/20/98  09:43:39 

02/20/98 

09:45:25 

N10C58P41 

N100C58P30 

02/20/98  09:43:40 

02/20/98 

09:45:25 

N10C58P42 

N100C58P29 

02/20/98  09:43:40 

02/20/98 

09:45:25 

N10C58P43 

N100C58P28 

02/20/98  09:43:40 

02/20/98 

09:45:25 

N10C58P44 

N100C58P27 

02/20/93  09:43:41 

02/20/98 

09:45:25 

N10C58P45 

N100C58P26 

02/20/98  09:43:42 

02/20/98 

09:45:26 

N10C58P46 

N100C58P25 

02/20/98  09:43:42 

02/20/98 

09:45:26 

N10C58P25 

N100C58P46 

02/20/98  09:43:19 

02/20/98 

09:45:26 

N10C58P26 

N10CC58P45 

02/20/98  09:47:26 

02/20/98 

09:50:36 

N1QC58P27 

N100C58P44 

02/20/98  09:47:25 

02/20/98 

09:50:36 

N10C58P28 

N100C58P43 

02/20/98  09:47:25 

02/20/98 

09:50:36 

N10C58P29 

N100C58P42 

02/20/98  09:47:26 

02/20/98 

09:50:36 

N10C58P30 

N100C58P41 

02/20/98  09:47:27 

02/20/98 

09:50:37 

N10C58P31 

N100C58P40 

02/20/98  09:47:27 

02/20/98 

09:50:37 

N10C58P32 

N100C58P39 

02/20/98  09:47:28 

02/20/98 

09:50:38 

N10C58P33 

N100C58P38 

02/20/98  09:47:28 

02/20/98 

09:50:38 

X58P34 

N100C58P37 

02/20/98  09:47:28 

02/20/98 

09:50:38 

iC58P35 

N100C58P36 

02/20/98  09:47:29 

02/20/98 

09:50:38 

N10C58P36 

M100C58P35 

02/20/98  09:47:30 

02/20/98 

09:50:39 

N10C58P37 

N100C58P34 

02/20/98  09:47:29 

02/20/98 

09:50:39 

N10C58P38 

N100C58P33 

02/20/98  09:47:31 

02/20/98 

09:50:40 

K10C58P39 

N100C58P32 

02/20/98  09:47:31 

02/20/98 

09:50:40 

K10C58P40 

N100C58P31 

02/20/98  09:47:31 

02/20/98 

09:50:40 

N10C58P41 

N100C58P30 

02/20/98  09:47:32 

02/20/98 

09:50:41 

N10C58P42 

N100C58P29 

02/20/98  09:47:33 

02/20/98 

09:50:41 

M10C58P43 

N100C58P28 

02/20/98  09:47:33 

02/20/98 

09:50:41 

N10C58P44 

N100C58P27 

02/20/98  09:47:34 

02/20/98 

09:50:41 

W10C58P45 

KI100C58P26 

02/20/98  09:47:34 

02/20/98 

09:50:42 

N 1 0C5SP46 

N100C58P25 

02/20/93  09:47:34 

02/20/98 

09:50:42 

N10CS8P25 

N100C58P46 

02/20/98  09:47:12 

02/20/98 

09:50:42 

N10C58P26 

N1C0C58P45 

02/20/98  11:57:25 

02/20/98 

11:58:22 

N10C58P27 

N100C58P44 

02/20/98  11:57:25 

02/20/98 

11:58:22 

M1QC58P28 

M100C58P43 

02/20/98  11:57:26 

02/20/98 

11:58:22 

N10C58P29 

N100C58P42 

02/20/98  11:57:26 

02/20/98 

11:58:22 

M10C58P30 

KM  00C58P41 

02/20/98  11:57:26 

02/20/98 

11:58:22 

N10C58P31 

N100C58P40 

02/20/98  11:57:26 

02/20/98 

11:58:23 

N10C58P32 

W100C58P39 

02/20/98  11:57:28 

02/20/98 

11:58:24 

M10C58P33 

N100C58P38 

02/20/98  11:57:28 

02/20/98 

11:58:24 

M10C58P34 

N100C58P37 

02/20/98  11:57:28 

02/20/98 

11:58:24 

N 1 0C58P35 

M100C58P36 

02/20/98  11:57:28 

02/20/98 

11:58:24 

h(10C58P36 

N10QC58P35 

02/20/98  11:57:30 

02/20/98 

11:58:25 

•0C58P37 

M10OC58P34 

02/20/98  11:57:29 

02/20/98 

11:58:25 

(C58P38 

N10QC58P33 

02/20/98  11:57:30 

02/20/98 

11:58:25 

.  0C5SP39 

Ml 00C58P32 

02/20/98  11:57*31 

02/20/98 

11:58:26 

N10C58P40 

M100C58P31 

02/20/98  11:57:31 

02/20/98 

11:58:26 

N10C58P41 

M100C58P30 

02/20/98  11:57:32 

02/20/98 

11:58:26 

N10C58P42 

K100C58P29 

02/20/98  11:57:32 

02/20/98 

11:58:26 

K10C58P43 

N100C58P28 

02/20/98  11:57:32 

02/20/98 

11:58:26 

Duration 

ddd:hh:mn:ss 

000:00:01:45 

000:00:01:46 

000:00:01:45 

000:00:01:45 

000:00:01:45 

000:00:01:44 

000:00:01:44 

000:00:01:44 

000:00:02:07 

000:00:03:10 

000:00:03:11 

000:00:03:11 

000:00:03:10 

000:00:03:10 

000:00:03:10 

000:00:03:10 

000:00:03:10 

000:00:03:10 

000:00:03:09 

000:00:03:09 

000:00:03:10 

000:00:03:09 

000:00:03:09 

000:00:03:09 

000:00:03:09 

000:00:03:08 

000:00:03:08 

000:00:03:07 

000:00:03:08 

000:00:03:08 

000:00:03:30 

000:00:00:57 

000:00:00:57 

000:00:00:56 

000:00:00:56 

000:00:00:56 

000:00:00:57 

000:00:00:56 

000:00:00:56 

000:00:00:56 

000:00:00:56 

000:00:00:55 

000:00:00:56 

000:00:00:55 

000:00:00:55 

000:00:00:55 

000:00:00:54 

000:00:00:54 

000:00:00:54 


call  Duration  Report  for  device  HI 0 
Hon  Pob  23  1 1 ; 59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Port 

Port 

nm/dd/yy 

hh :mm:ss 

mm/dd/yy 

hh:mm:ss 

N1QC58P44 

N100C58P27 

02/20/98 

11:57:33 

02/20/98 

11:58:26 

N10C58P45 

N100C58P26 

02/20/98 

11:57:34 

02/20/98 

11:58:27 

N10C58P46 

N100C58P25 

02/20/96 

1 1 ;57;34 

02/20/98 

11:58:27 

N10C58P25 

M100C58P46 

02/20/98 

11:57:12 

02/20/98 

11:58:28 

N10C5SP25 

N100C58P45 

02/20/98 

16:14:07 

02/20/98 

16:15:06 

N10C58P26 

N100C58P44 

02/20/98 

16:14:08 

02/20/98 

16:15:07 

N10C58P27 

N100C58P43 

02/20/98 

16:14:09 

02/20/98 

16:15:07 

N10C58P23 

H100C58P42 

02/20/98 

16:14:09 

02/20/98 

16:15:07 

N1GC58P29 

H100C58P41 

02/20/98 

16:14:09 

02/20/98 

16:15:07 

N1QC58P3G 

N100C58P40 

02/20/98 

16:14:09 

02/20/98 

16:15:07 

H10C58P31 

Ml 00C58P39 

02/20/98 

16:14:10 

02/20/98 

16:15:08 

N10C58P37 

N100C58P33 

02/20/98 

16:14:13 

02/20/98 

16:15:09 

M10C58P32 

N100C58P38 

02/20/98 

16:14:10 

02/20/98 

16:15:09 

N10C58P38 

N100C58P32 

02/20/98 

16:14:14 

02/20/98 

16:15:10 

K10C56P39 

H100C58P31 

02/20/98 

16:14:14 

02/20/98 

16:15:10 

H 1 0C5SP33 

M100C58P37 

02/20/98 

16:14:11 

02/20/98 

16:15:11 

N10C58P34 

N100C58P36 

02/20/98 

16:14:12 

02/20/98 

16:15:1 1 

'58P40 

M100C58P30 

02/20/98 

16:14:14 

02/20/98 

16:15:11 

X58P35 

H100C58P35 

02/20/98 

16:14:11 

02/20/98 

16:15:11 

N10C58P36 

N100C58P34 

02/20/98 

16:14:11 

02/20/98 

16:15:11 

N10C58P41 

N100C58P29 

02/20/98 

16:14:15 

02/20/98 

16:15:12 

N10C58P42 

N100C58P28 

02/20/98 

16:14:15 

02/20/98 

16:15:12 

N10C58P43 

N100C58P27 

02/20/98 

16:14:15 

02/20/98 

16:15:12 

N10C58P44 

N100C58P26 

02/20/98 

16:14:16 

02/20/98 

16:15:12 

N10C58P45 

M100C58P25 

02/20/98 

16:14:16 

02/20/98 

16:15:12 

N10C58P46 

N100C58P24 

02/20/98 

16:14:16 

02/20/98 

16:15:12 

N10C58P24 

N100C58P46 

02/20/98 

16:13:54 

02/20/98 

16:15:13 

N10C58P26 

N100C58P45 

02/20/98 

16:18:32 

02/20/98 

16:19:30 

N10C58P27 

N100C58P44 

02/20/98 

16:18:32 

02/20/98 

16:19:30 

M10C58P28 

W100C58P43 

02/20/98 

16:18:32 

02/20/98 

16:19:30 

N10C58P29 

N100C58P42 

02/20/98 

16:18:32 

02/20/98 

16:19:30 

N10C58P30 

N1C0C58P41 

02/20/98 

16:18:32 

02/20/98 

16:19:30 

N10C58P31 

N100C58P40 

02/20/98 

16:18:32 

02/20/98 

16:19:30 

N10C58P32 

N100C58P39 

02/20/98 

16:18:35 

02/20/98 

16:19:31 

N10C58P33 

N100C58P38 

02/20/98 

16:18:35 

02/20/98 

16:19:31 

N10C56P34 

H100C56P37 

02/20/98 

16:18:35 

02/20/90 

16:19:31 

N10C58P35 

N100C58P36 

02/20/98 

16:18:35 

02/20/98 

16:19:31 

N10C58P36 

N100C58P35 

02/20/98 

16:18:36 

02/20/98 

16:19:32 

N10C58P37 

M100C58P34 

02/20/98 

16:18:36 

02/20/98 

16:19:32 

N10C58P38 

N100C58P33 

02/2.0/98 

16:18:37 

02/20/98 

16:19:32 

N10C58P39 

N100C58P32 

02/20/98 

16:18:38 

02/20/98 

16:19:32 

N10C58P40 

N100C58P31 

02/20/98 

16:18:37 

02/20/98 

16:19:32 

'  ^C58P41 

N100C58P30 

02/20/98 

16:18:38 

02/20/98 

16:19:32 

:58P42 

N100C58P29 

02/20/98 

16:18:38 

02/20/98 

16:19:32 

r.  (0C58P43 

N100C58P28 

02/20/98 

16; 18:39 

02/20/98 

16:19:32 

M10C58P44 

M100C58P27 

02/20/98 

16:18:40 

02/20/98 

16:19:33 

N10C58P45 

Ml 00C58P26 

02/20/98 

16:18:40 

02/20/98 

16:19:33 

N10C58P46 

N100C58P25 

02/20/98 

16:18:40 

02/20/98 

16:19:33 

M10C58P25 

N100C58P46 

02/20/98 

16:18:18 

02/20/98 

16:19:34 

Duration 
ddd:hh:mm: ss 

000:00:00:53 
000:00:00:53 
000; 00; 00; 53 
000:00:01:16 
000; 00; 00; 59 
000:00:00:59 
000:00:00:58 
000:00:00:56 
000:00:00:58 
000:00:00:58 
000:00:00:58 
000:00:00:56 
000:00:00:59 
000:00:00:56 
000:00:00:56 
000:00:01:00 
000:00:00:59 
000:00:00:57 
000:00:01:00 
000:00:01:00 
000:00:00:57 
000:00:00:57 
000:00:00:57 
000:00:00:56 
000:00:00:56 
000:00:00:56 
000:00:01:19 
000:00:00:58 
000:00:00:58 
000:00:00:58 
000:00:00:56 
000:00:00:58 
000:00:00:58 
000:00:00:56 
000:00:00:56 
000:00:00:56 
000:00:00:56 
000:00:00:56 
000:00:00:56 
000:00:00:55 
000:00:00:54- 
000:00:00:55 
000:00:00:54 
000:00:00:54 
000:00:00:53 
000:00:00:53 
000:00:00:53 
000:00:00:53 
000:00:01:16 


Cat l  Duration  Report  for  device  N10 
Mon  Feb  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  1 

f  i  me 

Disconnect  Time 

Port 

Port 

rrm/dd/yy  hh:mm:ss 

mm/d d/yy  hh:mm:ss 

N10C58P26 

N100C58P45 

02/20/98 

16:21:21 

02/20/98 

16:23:30 

N1QC58P27 

N100C58P44 

02/20/98 

16:21:22 

02/20/98 

16:23:31 

N10C58P28 

N100C58P43 

02/20/98 

16:21:22 

02/20/98 

16:23:31 

N10C58P29 

N100C58P42 

02/20/98 

16:21:22 

02/20/98 

16:23:31 

N10C58P30 

N100C58P41 

02/20/98 

16:21:22 

02/20/98 

16:23:31 

N10C58P31 

N100C58P40 

02/20/98 

16:21:22 

02/20/98 

16:23:31 

N10C58P32 

N100C58P39 

02/20/98 

16:21:24 

02/20/98 

16:23:31 

N10C58P33 

N100C58P38 

02/20/98 

16:21:24 

02/20/98 

16:23:31 

N10C58P34 

N100C58P37 

02/20/98 

16:21:24 

02/20/98 

16:23:31 

N10C58P35 

N100C58P36 

02/20/98 

16:21:25 

02/20/98 

16:23:31 

W10C58P36 

N100C58P35 

02/20/98 

16:21:25 

02/20/98 

16:23:32 

N10C58P37 

N100C58P34 

02/20/98 

16:21:25 

02/20/98 

16:23:32 

N10C58P38 

N100C58P33 

02/20/98 

16:21:27 

02/20/98 

16:23:33 

N10C58P39 

N100C58P32 

02/20/98 

16:21:27 

02/20/98 

16:23:33 

N10C58P40 

N100C58P31 

02/20/98 

16:21:27 

02/20/98 

16:23:33 

N10C58P41 

N100C58P30 

02/20/98 

16:21:28 

02/20/98 

16:23:34 

N10C58P42 

N100C58P29 

02/20/98 

16:21:28 

02/20/98 

16:23:34 

'58P43 

N100C58P28 

02/20/98 

16:21:28 

02/20/98 

16:23:34 

C58P44 

N100C58P27 

02/20/98 

16:21:29 

02/20/98 

16:23:34 

N10C58P45 

N100C53P26 

02/20/98 

16:21:30 

02/20/98 

16:23:34 

N10C58P46 

N1G0C58P25 

02/20/98 

16:21:30 

02/20/98 

16:23:34 

N10C58P25 

N100C58P46 

02/20/98 

16:21:08 

02/20/98 

16:23:38 

K10C58P47 

N10C43P5 

02/19/98 

09:50:39 

02/20/98 

16:40:23 

N10C27P2 

N100C27P0 

12/17/97 

15:58:59 

02/20/98 

16:46:48 

W10C27P2 

N100C27P0 

02/20/98 

16:47:49 

02/20/98 

16:49:00 

N10C58P47 

N1GC43P5 

02/20/98 

16:41:13 

02/20/98 

17:20:47 

N10C59P6 

N60C43P1 

02/01/98 

11:28:36 

02/20/98 

17:22:35 

N10C58P47 

N10C59P6 

02/20/98 

17:23:17 

02/20/98 

17:24:56 

N10C58P25 

N100C58P25 

02/20/98 

17:33:33 

02/20/98 

17:34:55 

N10C5BP26 

N100C58P26 

02/20/98 

17:33:33 

02/20/98 

17:34:55 

K10C58P27 

N100C58P27 

02/20/98 

17:33:34 

02/20/98 

17:34:56 

N10C58P28 

N100C58P28 

02/20/98 

17:33:34 

02/20/98  17:34:56 

N10C58P29 

N100C58P29 

02/20/98 

17:33:34 

02/20/98 

17:34:56 

N10C58P30 

N100C58P30 

02/20/93 

17:33:34 

02/20/98 

17:34:56 

N10C58P31 

N100C58P31 

02/20/98 

17:33:36 

02/20/98 

17:34:56 

n10c5$p32 

N100C58P32 

02/20/98 

17:33:36 

02/20/98 

17:34:56 

N10C55P33 

N100C58P33 

02/20/98 

17:33:36 

02/20/98 

17:34:56 

N10C58P34 

N100C58P34 

02/20/98 

17:33:37 

02/20/98 

17:34:57 

N10C58P35 

N100C58P35 

02/20/98 

17:33:37 

02/20/98 

17:34:57 

N10C58P36 

N100C58P36 

02/20/98 

17:33:37 

02/20/98 

17:34:57 

N10C58P37 

N100C58P37 

02/20/98 

17:33:38 

02/20/98 

17:34:57 

N10C58P38 

N100C58P38 

02/20/98 

17:33:39 

02/20/98 

17:34:57 

•  'C58P39 

N100C58P39 

02/20/98 

17:33:39 

02/20/98 

17:34:58 

C58P40 

N100C58P40 

02/20/98 

17:33:39 

02/20/98 

17:34:58 

« f  0C58P41 

N100C58P41 

02/20/98 

1 7; 33 ; 40 

02/20/98 

17:34:58 

N10C58P42 

N100CS8P42 

02/20/98 

17:33:41 

02/20/98 

17:34:59 

N1QC58P43 

N100C58P43 

02/20/98 

17:33:42 

02/20/98 

17:35:00 

W10C58P44 

N100C58P44 

02/20/98 

17:33:42 

02/20/98 

17:35:00 

N10C58P45 

N100C58P45 

02/20/98 

17:33:42 

02/20/98 

17:35:00 

Duration 
ddd:hh :mm:ss 

000:00:02:09 

000:00:02:09 

000:00:02:09 

000:00:02:09 

000:00:02:09 

000:00:02:09 

000:00:02:07 

000:00:02:07 

000:00:02:07 

000:00:02:06 

000:00:02:07 

000:00:G2:07 

000:00:02:06 

000:00:02:06 

000:00:02:06 

000:00:02:06 

000:00:02:06 

000:00:02:06 

000:00:02:05 

000:00:02:04 

000:00:02:04 

000:00:02:30 

001:06:49:44 

065:00:47:49 

000:00:01:11 

000:00:39:34 

019:05:53:59 

000:00:01:39 

000:00:01:22 

000:00:01:22 

000:00:01:22 

000:00:01:22 

000:00:01:22 

000:00:01:22 

000:00:01:20 

000:00:01:20 

000:00:01:20 

000:00:01:20 

000:00:01:20 

000:00:01:20 

000:00:01:19 

000:00:01:18 

000:00:01:19 

000:00:01:19 

000:00:01:18 

000:00:01:18 

000:00:01:18 

000:00:01:18 

000:00:01:18 


Call  Duration  Report  for  device  Ml 0 
Mon  Feb  23  11:59:41  1998 

From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Terminat i on 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hhimmuss 

mm/dd/yy 

hh:mm:ss 

ddd:hh:mm:ss 

N10C5SP46 

N100C58P46 

02/20/98  17:33:42 

02/20/98 

17:35:00 

000:00:01:18 

N1QC58P24 

N100C58P24 

02/20/98  17:33:19 

02/20/98 

17:35:00 

000:00:01:41 

N1GC58P25 

M100C58P25 

02/20/98  17:38:55 

02/20/98 

17:40:42 

000:00:01:47 

N10C58P26 

N100C58P26 

02/20/98  17:38:56 

02/20/98 

17:40:43 

000:00:01:47 

M10C58P27 

N100C58P27 

02/20/98  17:38:56 

02/20/98 

17:40:43 

000:00:01:47 

W10C58P28 

N1D0C5SP2S 

02/20/98  17:38:56 

02/20/98 

17:40:43 

000:00:01:47 

M1QC58P29 

M100C58P29 

02/20/98  17:38:56 

02/20/98 

17:40:43 

000:00:01:47 

M10C58P30 

Ml 00C58P30 

02/20/98  17:38:56 

02/20/98 

17:40:43 

000:00:01:47 

M10C58P31 

N100C58P31 

02/20/98  17:38:58 

02/20/98 

17:40:43 

000:00:01:45 

M10C58P32 

N100C58P32 

02/20/98  17:38:53 

02/20/98 

17:40:44 

000:00:01:46 

M10C58P33 

N100C58P33 

02/20/98  17:38:59 

02/20/98 

17:40:45 

000:00:01:46 

N10C58P34 

M100C58P34 

02/20/98  17:38:59 

02/20/98 

17:40:45 

000:00:01:46 

M10C58P35 

M100C58P35 

02/20/98  17:38:59 

02/20/98 

17:40:45 

-000:00:01:46 

N10C58P36 

N100C58P36 

02/20/93  17:38:59 

02/20/98 

17:40:45 

000:00:01:46 

N10C5SP37 

N100C58P37 

02/20/98  17:39:01 

02/20/98 

17:40:46 

000:00:01:45 

N10C58P38 

M100C58P38 

02/20/98  17:39:01 

02/20/98 

17:40:46 

000:00:01:45 

M10C58P39 

M100C58P39 

02/20/98  17:39:01 

02/20/98 

17:40:46 

000:00:01:45 

1C58P40 

N100C58P40 

02/20/98  17:39:02 

02/20/98 

17:40:46 

000:00:01:44 

JC58P41 

M100C58P41 

02/20/98  17:39:02 

02/20/98 

17:40:47 

000:00:01:45 

N10C58P42 

M100C58P42 

02/20/98  17:39:02 

02/20/98 

17:40:47 

000:00:01:45 

M10C58P43 

M100C58P43 

02/20/98  17:39:03 

02/20/98 

17:40:47 

000:00:01:44 

M10C58P44 

M100C58P44 

02/20/98  17:39:03 

02/20/98 

17:40:47 

000:00:01:44 

M10C58P45 

N100C58P45 

02/20/98  17:39:04 

02/20/98 

17:40:4 7 

000:00:01:43 

N10C58P46 

N100C58P46 

02/20/98  17:39:04 

02/20/98 

17:40:48 

000:00:01:44 

N10C58P24 

■N100C58P24 

02/20/98  17:38:41 

02/20/98 

17:40:48 

000:00:02:07 

M10C58P25 

N100C58P25 

02/20/98  17:53:36 

02/20/98 

17:55:54 

000:00:02:18 

N10C58P26 

N100C58P26 

02/20/98  17:53:37 

02/20/98 

17:55:55 

000:00:02:18 

N10C58P27 

N100C58P27 

02/20/98  17:53:3 7 

02/20/98 

17:55:55 

000:00:02:18 

M10C58P28 

M100C58P28 

02/20/98  17:53:37 

02/20/98 

17:55:55 

000:00:02:18 

N10C58P29 

N100C58P29 

02/20/98  17:53:38 

02/20/98 

17:55:55 

000:00:02:17 

M10C58P30 

N1C0C58P30 

02/20/98  17:53:38 

02/20/98 

17:55:55 

000:00:02:17 

N1QC58P31 

M100C58P31 

02/20/98  17:53:40 

02/20/98 

17:55:56 

000:00:02:16 

N10C58P32 

M100C58P32 

02/20/98  17:53:40 

02/20/98 

17:55:56 

000:00:02:16 

N10C58P33 

W100C58P33 

02/20/98  17:53:40 

02/20/98 

17:55:56 

000:00:02:16 

N10C58P34 

N1C0C58P34 

02/20/98  17:53:40 

02/20/98 

17:55:57 

000:00:02:17 

M10C58P35 

M100C58 P35 

02/20/98  17:53:40 

02/20/98 

17:55:57 

000:00:02:17 

N10C58P36 

N100C58P36 

02/20/98  17:53:41 

02/20/98 

17:55:5 7 

000:00:02:16 

M10C58P37 

M100C5SP37 

02/20/98  17:53:42 

02/20/98 

17:55:57 

000:00:02:15 

N10C58P38 

N100C58P38 

02/20/98  17:53:42 

02/20/98 

17:55:57 

000:00:02:15 

N10C58P39 

N100C58P39 

02/20/98  17:53:43 

02/20/98 

17:55:58 

000:00:02:15 

M10C58P40 

M100C58P40 

02/20/98  17:53:43 

02/20/98 

17:55:59 

000:00:02:16 

N10C58P41 

N100C58P41 

02/20/98  17:53:43 

02/20/98 

17:55:59 

000:00:02:16 

1-40C$8P42 

M100C58P42 

02/20/98  17:53:43 

02/20/98 

17:55:59 

000:00:02:16 

/C58P43 

K100C58P43 

02/20A98  17:53:45 

02/20/98 

17:56:00 

000:00:02:15 

0C58P44 

W100C58P44 

02/20/98  17:53:46 

02/20/98 

17:56:00 

000:00:02:14 

M10C58P45 

N100C58P45 

02/20/98  17:53:46 

02/20/98 

17:56:00 

000:00:02:14 

M10C58P46 

N100C58P46 

02/20/98  17:53:46 

02/20/98 

17:56:00 

000:00:02:14 

M10C58P24 

M100C58P24 

02/20/98  17:53:23 

02/20/98 

17:56:00 

000:00:02:37 

N10C55P1 

M20C39P0 

02/05/98  16:22:41 

02/20/98 

19:55:44 

015:03:33:03 

Call  Duration  Report  for  device  N1Q 
Mon  Feb  23  11:59:41  1993 

From  02/16/93  00:00:00  to  02/23/93  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

mm/dd/yy  hh:nm:ss 

rrrr/dd/yy 

hh:mm;ss 

ddd:hh:rrcn:ss 

N10C55P1 

N20C39P0 

02/20/98  20:00:15 

02/20/98 

20:00:23 

000:00:00:05 

M10C39P6 

N10C55P0 

01/28/98  18:21:41 

02/20/98 

22:27:18 

023:04:05:37 

N10C55P1 

N20C39P0 

02/20/98  20:05:24 

02/20/98 

22:27:18 

000:02:21:54 

N10C55P2 

N51C10P0 

02/03/98  10:55:05 

02/20/98 

22:27:18 

017:11:32:13 

N10C55P3 

N14C10P0 

02/17/95  19:56:36 

02/20/98 

22:27:18 

003:02:30:42 

N10C55P4 

N83C10P0 

01/30/98  14:32:14 

02/20/98 

22:27:18 

021:07:55:04 

N10C55P5 

N60C39P0 

02/01/98  11:28:25 

02/20/98 

22:27:18 

019:10:58:53 

N10C55P8 

N80C10P0 

02/02/95  14:47:44 

02/20/98 

22:27:18 

018:07:39:34 

N10C70P0 

W1QC55P11 

12/17/97  15:58:02 

02/20/98 

22:27:18 

065:06:29:16 

N10C70P1 

N10C55P15 

12/17/97  15:58:02 

02/20/98 

22:27:18 

065:06:29:16 

M10C39P5 

N19C10P0 

12/24/97  19:28:32 

02/21/98 

16:38:20 

058:21:09:48 

N1QC58P25 

NT00C58P25 

02/22/98  04:26:24 

02/22/98 

04:27:19 

000:00:00:55 

N10C58P26 

N100C58P26 

02/22/98  04:26:24 

02/22/98 

04:27:19 

000:00:00:55 

N10C58P27 

N100C58P27 

02/22/98  04:26:24 

02/22/98 

04:27:19 

000:00:00:55 

H10C58P28 

N100C58P28 

02/22/98  04:26:24 

02/22/98 

04:27:19 

000:00:00:55 

K10C58P29 

N100C58P29 

02/22/98  04:26:24 

02/22/98 

04:27:19 

000:00:00:55 

N10C58P30 

N100C58P30 

02/22/98  04:26:24 

02/22/98 

04:27:19 

000:00:00:55 

■C58P31 

M100C58P31 

02/22/98  04:26:26 

02/22/98 

04:27:19 

000:00:00:53 

.0C58P32 

N100C58P32 

02/22/98  04:26:26 

02/22/98 

04:27:20 

000:00:00:54 

N10CS8P33 

N100C58P33 

02/22/98  04:26:26. 

02/22/98 

04:27:20 

000:00:00:54 

N10C58P34 

N100C58P34 

02/22/98  04:26:2 7 

02/22/98 

04:27:20 

000:00:00:53 

N10C58P35 

N100C58P35 

02/22/98  04:26:27 

02/22/98 

04:27:20 

000:00:00:53 

W10C58P36 

N100C58P36 

02/22/98  04:26:27 

02/22/98 

04:27:20 

000:00:00:53 

N10C58P37 

N100C58P37 

02/22/98  04:26:28 

02/22/98 

04:27:20 

000:00:00:52 

N10C58P38 

N100C58P38 

02/22/98  04:26:29 

02/22/98 

04:27:21 

000:00:00:52 

N10C58P39 

N100C58P39 

02/22/98  04:26:29 

02/22/98 

04:27:21 

000:00:00:52 

N10C58P40 

N100C58P40 

02/22/98  04:26:30 

02/22/98 

04:27:22 

000:00:00:52 

N10C58P41 

N100C5SP41 

02/22/98  04:26:30 

02/22/98 

04:27:22 

000:00:00:52 

N10C58P42 

N100C58P42 

02/22/98  04:26:30 

02/22/98 

04:27:22 

000:00:00:52 

W10C58P43 

N100C58P43 

02/22/93  04:26:32 

02/22/98 

04:27:23 

000:00:00:51 

N10C58P44 

N1Q0C58P44 

02/22/98  04:26:32 

02/22/98 

04:27:23 

000:00:00:51 

N10C58P45 

N100C58P45 

02/22/98  04:26:32 

02/22/98 

04:27:24 

000:00:00:52 

K10C58P46 

N100C58P46 

02/22/98  04:26:33 

02/22/98 

04:27:24 

000:00:00:51 

K10C58P24 

N100C58P24 

02/22/98  04:26:10 

02/22/98 

04:27:24 

000:00:01:14 

M10C55P8 

N8QC10P0 

02/20/98  22:27:59 

02/22/98 

12:27:46 

001:13:59:47 

N1GC43P4 

N80C22PO 

02/19/98  09:49:45 

02/22/96 

12:27:46 

003:02:38:01 

M10C58P25 

N100C58P25 

02/23/98  02:54:46 

02/23/98 

02:57:02 

000:00:02:16 

N10C58P26 

N100C58P26 

02/23/98  02:54:47 

02/23/98 

02:57:03 

000:00:02:16 

N10C58P27 

N100C58P27 

02/23/98  02:54:47 

02/23/98 

02:57:03 

000:00:02:16 

N10C58P28 

N100C58P28 

02/23/98  02:54:47 

02/23/98 

02:57:03 

000:00:02:16 

N10C58P29 

N100C58P29 

02/23/98  02:54:47 

02/23/98 

02:57:03 

000:00:02:16 

M10C58P30 

N10DC58P30 

02/23/98  02:54:47 

02/23/98 

02:57:03 

000:00:02:16 

nC58P31 

N100C58P31 

02/23/98  02:54:49 

02/23/98 

02:57:03 

000:00:02:14 

jCSSP32 

N100C58P32 

02/23/98  02:54:50 

02/23/98 

02:57:05 

000:00:02:15 

N10C5SP33 

N100C58P33 

02/23/98  02:54:50 

02/23/98 

02:57:05 

000:00:02:15 

N10C58P34 

N100C58P34 

02/23/98  02:54:51 

02/23/98 

02:57:05 

000:00:02:14 

N10C58P35 

N100C58P35 

02/23/98  02:54:51 

02/23/98 

02:57:05 

000:00:02:14 

N10C58P36 

N100C58P36 

02/23/98  02:54:51 

02/23/98 

02:57:06 

000:00:02:15 

N10C58P37 

N100C58P37 

02/23/98  02:54:52 

02/23/98 

02:57:06 

000:00:02:14 

Cal l  Duration  Report  for  device  N10 
Mon  Fe b  23  11:59:41  1998 


From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Port 

Port 

rrm/dd/yy 

hh :mm: ss 

mm/dd/yy 

hh  :mm: ss 

K10C58P38 

N100C58P38 

02/23/98 

02:54:52 

02/23/98 

02:57:06 

N10C58P39 

N100C58P39 

02/23/98 

02:54:53 

02/23/98 

02:57:07 

N10C58P40 

N100C58P40 

02/23/98 

02:54:53 

02/23/98 

02:57:07 

N10C53P41 

N100C58P41 

02/23/98 

02:54:53 

02/23/98 

02:57:07 

N10C58P42 

N100C58P42 

02/23/93 

02:54:53 

02/23/98 

02:57:0 7 

N10C58P43 

M100C58P43 

02/23/98 

02:54:54 

02/23/98 

02:57:07 

N10C58P44 

N100C58P44 

02/23/98 

02:54:56 

02/23/98 

02:57:08 

N10C58P45 

N100C58P45 

02/23/98 

02:54:56 

02/23/98 

02:57:08 

N10C58P46 

N100C58P46 

02/23/98 

02:54:56 

02/23/98 

02:57:08 

N10C58P24 

N100C58P24 

02/23/98 

02:54:33 

02/23/98 

02:57:09 

W10C25P41 

N1C0C57P5 

02/23/98 

06:53:58 

02/23/98 

06:54:28 

N10C25P42 

N100C57P4 

02/23/98 

06:53:58 

02/23/98 

06:54:29 

N10C25P43 

N100C57P3 

02/23/98 

06:53:57 

02/23/98 

06:54:29 

N10C25P44 

N100C57P2 

02/23/98 

06:53:57 

02/23/98 

06:54:29 

N10C25P45 

H100C57P1 

02/23/98 

06:53:57 

02/23/98 

06:54:30 

K10C25P46 

M100C57PO 

02/23/98 

06:53:55 

02/23/98 

06:54:30 

N10C25P41 

N100C57P5 

02/23/98 

07:14:56 

02/23/98 

08:04:31 

C25P42 

N1C0C57P4 

02/23/98 

07:14:55 

02/23/98 

08:04:31 

JC25P43 

M1C0C57P3 

02/23/98 

07:14:56 

02/23/98 

08:04:32 

N10C25P44 

N100C57P2 

02/23/98 

07:14:55 

02/23/98 

08:04:32 

N10C25P45 

M100C57P1 

02/23/98 

07:14:54 

02/23/98 

08:04:32 

N10C25P46 

K100C57P0 

02/23/98 

07:14:53 

02/23/98 

08:04:33 

N1CC25P46 

N82C2OP0 

02/23/98 

08:16:41 

02/23/98 

08:17:15 

N10C25P41 

N62C20P5 

02/23/93 

08:16:46 

02/23/98 

08:17:16 

N10C25P42 

M82C20P4 

02/23/98 

08:16:44 

02/23/98 

08:17:16 

N1QC25P43 

N82C2QP3 

02/23/98 

08:16:44 

02/23/98 

08:17:16 

N10C25P44 

N82C2QP2 

02/23/98 

08:16:44 

02/23/98 

08:17:17 

W10C25P45 

K82C20P1 

02/23/98 

08:16:43 

02/23/98 

08:17:17 

N10C25P46 

N82C20P0 

02/23/98 

08:18:53 

02/23/98 

09:17:15 

N10C25P41 

W82C20P5 

02/23/98 

08:18:57 

02/23/98 

09:17:16 

N10C25P42 

N82C20P4 

02/23/98 

08:18:57 

02/23/98 

09:17:16 

N10C25P43 

N82C20P3 

02/23/98 

08:18:56 

02/23/98 

09:17:16 

N1GC25P44 

N82C20P2 

02/23/98 

08:18:55 

02/23/98 

09:17:16 

N10C25P45 

N82C2QP1 

02/23/98 

08:18:56 

02/23/98 

09:17:17 

N10C58P25 

K100C58P25 

02/23/98 

09:18:15 

02/23/98 

09:25:09 

K10C58P26 

K10QC58P26 

02/23/98 

09; 16; 15 

02/23/98 

09:25:09 

N10C58P27 

M100C58P27 

02/23/98 

09:18:15 

02/23/98 

09:25:09 

N10C58P28 

N1Q0C58P28 

02/23/98 

09:18:15 

02/23/98 

09:25:09 

N10C58P29 

N100C58P29 

02/23/98 

09:18:15 

02/23/98 

09:25:09 

N10C58P30 

N100C58P30 

02/23/98 

09:18:16 

02/23/98 

09:25:09 

N10C58P31 

N100C58P31 

02/23/98 

09:18:1 7 

02/23/98 

09:25:09 

W10C58P32 

N100C58P32 

02/23/98 

09:18:18 

02/23/98 

09:25:10 

nC58P33 

N100C58P33 

02/23/98 

09:18:18 

02/23/98 

09:25:10 

.C58P34 

H100C58P34 

02/23/98 

09:18:18 

02/23/98 

09:25:10 

n10C5QP35 

N100C5SP35 

02/23/98 

09:16:18 

02/23/98 

09:25:10 

N10C58P36 

N100C58P36 

02/23/98 

09:18:20 

02/23/98 

09:25:11 

N10C58P37 

N100C58P37 

02/23/98 

09:18:21 

02/23/98 

09:25:11 

M10C58P38 

M100C58P38 

02/23/98 

09:18:21 

02/23/98 

09:25:11 

K10C58P39 

M100C58P39 

02/23/98 

09:18:21 

02/23/98 

09:25:11 

Duration 

ddd:hh:mm:ss 

000:00:02:14 

000:00:02:14 

000:00:02:14 

000:00:02:14 

000:00:02:14 

000:00:02:13 

000:00:02:12 

000:00:02:12 

000:00:02:12 

000:00:02:36 

000:00:00:30 

000:00:00:31 

000:00:00:32 

000:00:00:32 

000:00:00:33 

000:00:00:35 

000:00:49:35 

000:00:49:36 

000:00:49:36 

000:00:49:37 

000:00:49:38 

000:00:49:40 

000:00:00:34 

000:00:00:30 

000:00:00:32 

000:00:00:32 

000:00:00:33 

000:00:00:34 

000:00:58:22 

000:00:58:19 

000:00:58:19 

000:00:58:20 

000:00:58:21 

000:00:58:21 

000:00:06:54 

000:00:06:54 

000:00:06:54 

000:00:06:54 

000:00:06:54 

000:00:06:53 

000:00:06:52 

000:00:06:52 

000:00:06:52 

000:00:06:52 

000:00:06:52 

000:00:06:51 

000:00:06:50 

000:00:06:50 

000:00:06:50 


Call  Duration  Report  for  device  Ml 0 
M6 n  23  11:50:41  1098 


From  02/16/08  00:00:00  to  02/23/98  23:59:00 


Origination 

terminat ion 

Connect  Time 

Disconnect  Time 

Port 

Port 

rmt/dd/yy 

hh:mm:ss 

rm/dd/yy 

hh :mm:ss 

H10C58P40 

N100C58P40 

02/23/98 

09:18:22 

02/23/98 

09:25:11 

N10C58P41 

N1D0C58P41 

02/23/98 

09:18:22 

02/23/98 

09:25:11 

M10C58P42 

N100C58P42 

02/23/98 

09:18:22 

02/23/98 

09:25:12 

N10C58P43 

N100C58P43 

02/23/98 

09:18:23 

02/23/98 

09:25:12 

N10C58P44 

W100C5SP44 

02/23/98 

09:18:24 

02/23/98 

09:25:12 

N10C58P45 

W100C58P45 

02/23/98 

09:18:23 

02/23/98 

09:25:12 

N10C58P46 

N100C58P46 

02/23/98 

09:18:24 

02/23/98 

09:25:13 

N10C58P24 

N100C58P24 

02/23/98 

09:18:01 

02/23/98 

09:25:13 

N10C58P25 

N100C58P25 

02/23/98 

09:34:02 

02/23/98 

09:35:25 

N10C58P26 

N1C0C58P26 

02/23/98 

09:34:02 

02/23/98 

09:35:25 

N1GC58P27 

N100C58P27 

02/23/98 

09:34:03 

02/23/98 

09:35:26 

N10C58P28 

H100C58P28 

02/23/98 

09:34:03 

02/23/98 

09:35:26 

N10C58P29 

N100C58P29 

02/23/98 

09:34:03 

02/23/98 

09:35:26 

N10C58P30 

N100C58P30 

02/23/98 

09:34:03 

02/23/98 

09:35:26 

K10C58P31 

M100C58P31 

02/23/98 

09:34:05 

02/23/98 

09:35:26 

N1CC58P32 

M100C58P32 

02/23/98 

09:34:05 

02/23/98 

09:35:26 

N1CC58P33 

N100C58P33 

02/23/98 

09:34:05 

02/23/98 

09:35:26 

'C58P34 

N100C58P34 

02/23/98 

09:34:05 

02/23/98 

09:35:26 

>C58P35 

N1C0C58P35 

02/23/98 

09:34:06 

02/23/98 

09:35:27 

N10C58P36 

N100C58P36 

02/23/98 

09:34:06 

02/23/98 

09:35:27 

H10C58P37 

N100C58P37 

02/23/98 

09:34:07 

02/23/98 

09:35:27 

K10C58P38 

N100C58P38 

02/23/98 

09:34:07 

02/23/98 

09:35:27 

N1DC58P39 

N100C58P39 

02/23/98 

09:34:07 

02/23/98 

09:35:27 

N10C58P40 

N100C58P40 

02/23/98 

09:34:09 

02/23/98 

09:35:26 

N10C58P41 

K100C58P41 

02/23/98 

09:34:08 

02/23/98 

09:35:28 

N10C58P42 

H100C58P42 

02/23/98 

09:34:09 

02/23/98 

09:35:28 

M10C58P43 

N100C58P43 

02/23/98 

09:34:10 

02/23/98 

09:35:29 

N10C58P44 

N100C58P44 

02/23/98 

09:34:10 

02/23/98 

09:35:29 

K10C58P45 

M100C58P45 

02/23/98 

09:34:10 

02/23/98 

09:35:29 

K10C58P46 

N100C58P46 

02/23/98 

09:34:11 

02/23/98 

09:35:30 

N10C58P24 

N100C58P24 

02/23/98 

09:33:48 

02/23/98 

09:35:30 

M10C58P25 

N100C58P25 

02/23/98 

09:36:18 

02/23/98 

09:38:18 

K10C58P26 

N100C58P26 

02/23/98 

09:36:18 

02/23/98 

09:38:18 

N10C58P27 

N1C0C58P27 

02/23/98 

09:36:18 

02/23/98 

09:38:18 

N10C58P28 

W100C58P28 

02/23/98 

09:36:18 

02/23/98 

09:38:18 

W10C5SP29 

M100C5AP29 

05/23/98 

09:36:19 

02/23/98 

09:38:18 

H10C58P30 

N100C58P30 

02/23/98 

09:36:19 

02/23/98 

09:38:18 

N10C58P31 

H100C58P31 

02/23/98 

09:36:21 

02/23/98 

09:38:19 

N10C58P32 

N100C58P32 

02/23/98 

09:36:21 

02/23/98 

09:38:19 

N10C58P33 

N100C58P33 

02/23/98 

09:36:21 

02/23/98 

09:38:19 

N10C58P34 

N100C58P34 

02/23/98 

09:36:22 

02/23/98 

09:38:21 

N10C58P35 

N100C58P35 

02/23/98 

09:36:22 

02/23/98 

09:38:21 

l,*nc58P36 

N 1 00C58P36 

02/23/98 

09:36:22 

02/23/98 

09:38:21 

C58P37 

N100C58P37 

02/23/98 

09:36:24 

02/23/98 

09:38:21 

iOC58P38 

N100C58P38 

02/23/98 

09:36:24 

02/23/98 

09:38:21 

N10C58P39 

N100C58P39 

02/23/98 

09:36:24 

02/23/98 

09:38:22 

N10C58P40 

N100C58P40 

02/23/98 

09:36:24 

02/23/98 

09:38:22 

N10C58P41 

N100C58P41 

02/23/98 

09:36:25 

02/23/98 

09:38:23 

N10C58P42 

N100C58P42 

02/23/98 

09:36:25 

02/23/98 

09:38:23 

Duration 

ddd:hh:mm:ss 

000:00:06:49 

000:00:06:49 

000:00:06:50 

000:00:06:49 

000:00:06:48 

000:00:06:49 

000:00:06:49 

000:00:07:12 

000:00:01:23 

000:00:01:23 

000:00:01:23 

000:00:01:23 

000:00:01:23 

000:00:01:23 

000:00:01:21 

000:00:01:21 

000:00:01:21 

000:00:01:21 

000:00:01:21 

000:00:01:21 

000:00:01:20 

000:00:01:20 

000:00:01:20 

000:00:01:19 

000:00:01:20 

000:00:01:19 

000:00:01:19 

000:00:01:19 

000:00:01:19 

000:00:01:19 

000:00:01:42 

000:00:02:00 

000:00:02:00 

000:00:02:00 

000:00:02:00 

000:00:01:59 

000:00:01:59 

000:00:01:58 

000:00:01:58 

000:00:01:58 

000:00:01:59 

000:00:01:59 

000:00:01:59 

000:00:01:57 

000:00:01:57 

000:00:01:58 

000:00:01:58 

000:00:01:58 

000:00:01:58 


Call  Duration  Report  for  device  M10 
non  Feb  23  11:59:41  199B 

From  02/16/98  00:00:00  to  02/23/98  23:59:00 


Origination 

Termination 

Connect  Time 

Disconnect  Time 

Duration 

Port 

Port 

im/dd/yy  hh:(mt:ss 

nrn/dd/yy 

hh:mm:ss 

dddrhh:  [truss 

N10C58P43 

N100C58P43 

02/23/98  09:36:26 

02/23/98 

09:38:23 

000:00:01:57 

N10C58P44 

N100C58P44 

02/23/98  09:36:27 

02/23/98 

09:38:23 

000:00:01:56 

H10CS8P45 

M100C58P45 

02/23/98  09:36:28 

02/23/98 

09:38:24 

000:00:01:56 

N10C58P46 

N1QQC58P46 

02/23/98  09:36:28 

02/23/98 

09:38:24 

000:00:01:56 

N10C58P24 

N100C58P24 

02/23/98  09:36:05 

02/23/98 

09:38:24 

000:00:02:19 

N10C58P25 

N100C58P25 

02/23/98  11:07:10 

02/23/98 

11:09:34 

000:00:02:24 

N10C58PZ6 

N100C58P26 

02/23/98  11:07:10 

02/23/98 
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APPENDIX  V 

SAMPLE  GROUPING  OF  INITIATIVES  BASED  ON  OBVIOUS 

RELATIONSHIPS 


(VTC,  REAL-TIME,  STORE-AND-FORWARD  TELEMEDICINE) 
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DATA  COLLECTION  SUMMARY 
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